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The past few decades have witnessed dramatic developments in 
technology. One example from each decade can serve to illustrate 
the major changes, especially those occurring in the media field. 

1946 

ENIAC, the world*s first electronic computer, made its debut. It 
weighed 30 tons, contained 18,000 tubes and had a memory 
capable of storing only 20 numbers. Pocket calculators of today 
have a much greater capacity, md personal computers can easily 
store the contents of a book in internal memory. 

1956 

The first regularly scheduled TV transmissions began in Sweden. 
The American Ampex company introduced the first video tape 
recorder. It was a large, expensive machine with an insatiable 
appetite for 2-inch, open-reel tape. 1988, one-third of all 
Swedish households (33 %) have small, handy video cassette 
recorders, usually employing 1/2 inch tape. The corresponding 
figures for the United States and Japan are 46 % and 62 % 
respectively. 

1962 

The first communications satellite, Telstar, was launched into or- 
bit.In 1988, 600,000 Swedish households (8 %) could view 
satellite TV transmissions via local cable TV networks. At some 
locations in the United States, viewers have a choice of 50-60 
programs. Many channels also broadcast around the clock. 

1973 

The Dutch company Philips launched its optical video disc 
system. This medium permits the storage of truly vast amounts 
of information. CD-ROM discs of today are only 12 cm in 
diameter but can store 600 mega-bytes of information. All the 
text in several encyclopedias can be made easily accessible in a 
database stored in CD-ROM. 

1985 

The Japanese company Sony presented the world*s largest video 
screen, 40 x 25 meters, i.e. 1,000 m2 (10,764 ft2), at EXPO 85 
in the Tsukuba research village outside Tokyo. This "Jumbotron" 
image was more than two million times larger than a similar TV 
image on a wrist-watch TV. Flat, high-resolution video displays 
emitting virtually no harmful radiation are currently under 
development. 

So technical developments have moved at a very rapid pace. 
Everything suggests that the pace of developments is likely to 
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increase rather than decrease. So visual messages in different 
forms will become increasingly important. However, only 
limited knowledge is available on visual communications, 
pictures as a means of linguistic communications and the 
interplay between verbal and visual messages. So attention must 
be devoted to issues conceming the production, transmission and 
perception of verbo-visual messages. 

From June 10-13, 1987, the IVLA (International Visual 
Literacy Association), in collaboration with the University of 
Stockholm, held an international, interdisciplinary research 
symposium "Verbo-Visual Literacy: Research and Theory." 
About 35 scientists from 15 countries participated, directly or 
indirectly, and presented their research results. Participants ca.ne 
from countries as far away as Canada, India, Japan and the 
United States. However, most were from European countries. 

Current problem areas in verbo-visual research can be 
summarized under the heading Infology, i.e. knowledge of 
information. Infology comprises theoretical and empirical study 
of the way text, images and graphical shapes for informational 
material should be designed so as to optimize communications 
between senders and receivers. Thus, the field covers aspects of 
many "established" disciplines, such as visual arts, information 
science, esthetics, cinema, physiology, graphical design, in- 
formatics, journalism, communications, art, linguistics, mass- 
communications, pedagogics, semiology, sociology etc. 

This report maiiily deal with the "visual" part of verbo-visual 
research 
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Communication models 



Communications between people have always been important. 
Aspects of our society are becoming increasingly intertwined, 
and the need for communications between people is increasing at 
a fast pace. We need to communicate in order to establish 
contacts with one another to maintain and improve those 
contacts, to exchange infonnation and views and to develop 
ourselves and the society. If communication is to be possible at 
all, signals in some form must be transmitted, received and 
deciphered. Both animals and people communicate with the aid of 
simple signals. The signals may be aural or visual.They can also 
consist of odors or tactile contacts and, therefore act on our sense 
of smell and touch rather than on our hearing and vision. There is 
often an interplay between different signals or stimuli which 
coalesce into a unified whole. Simple signals usually elicit simple 
responses in the message recipient whose responses elicit 
responses from the original message transmitter etc. Information 
systems of considerable complexity can arise in this way. 

Many infonnation and communications theorists have devised 
models to explain the way the communications process operates. 
As early as 1948 Laswell put it this v;<ty: communications are 
WHO says WHAT to WHOM via which CHANNEL and to what 
EFFECT. At the same time. Shannon proposed the following 
model which illustrates the way infonnation is passed from a 
sender to a receivci. A message is selected by an Information 
Source and incorporated by the Transmitter into a signal which is 
received by a Receiver and transformed into the message reaching 
the Destination. The signal can be influenced by noise. 



noise 
source 



infor- 
mation 




trans- 
mitter 








receiver 




iQ stina- 
nation 


source 



















message s'gnal received signal message 



Shannon's 1948 communications model. 

We can be sure that people do not derive the same in- 
formation from things they read, hear or see. The meaning of any 
language, verbal or visual, is not only resident in words, lines, 
colors etc but in ourselves to a large degree. We have to learn to 
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assign meaning lo language symbols used. We have lo learn the 
codes, and ihey differ in different socieiies and in different 
cultures. 

Schramm used a model to show that there must also be some 
overlappnig in the fields of experience of the sender and of the 
ivceiver for communication to take place 



noise 



f'Ckj of experience 



fieW of experience 



signal 






'Jecxjder 


receiver 







feedback 



Scramm's adopting of the Shannon communicatiops model. 

Designers often produce instructional material for their own 
coun!er})arts. not for the people who need the infonnation. This is 
because many designers lack basic knowledge about 
communication possibilities. Subsequent models have 
uicorporated an increasing number of variables but often fail, in 
my view, in their treatment of perception processes. To obtain 
greater understanding about the factors involved in 
communication and in ai; effort to describe my special studies of 
visual literacy and picture variables in holistic perception. I 
devised the communications model presented below. 

In the production of information, a .sender conveys 
information on a part of reality via a representation to an 
mformation receiver who. via sensory impressions, is able to 
Obtain some perception of that reality. Tiiis perception may then 
evoke some response which affects the reality and/or creates some 
feedback to the original sender. The receiver's perception varies 
as a result of a number of factors, e g. his current cultural and 
social status, the time and stage of his development, his mood, 
experience, memory and other cognitive processes, such as cre- 
ativity, intelligence etc. Perception is divorced from the 
representation which, in turn is iJvorced from the reality 
(P?iRp?iR). Some of our sensory impressions give rise to 
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"garbage" and some to learning. Learning is transferred to the 
memory by cognitive means. The cognitive variables exert an 
influence on subsequent perceptions and may also evoke inner 
perceptions and inner imagery, such as creativity and other 
cognitive processes. 

"Noise" may intrude on various occasions and interfere with 
this process. Every "perception", such as a visual sensation, is 
actually composed of a large number of different sub-components 
which are aggregated into a single holistic impression. A 
representation, e.g. a visual, which is to be u.sed to convey certain 
information, has a sender, one or more receivers and even a 
content, of course, a structure, a context and a format. The visual 
is produced in a certain way v/ith respect to various variables. The 
model shows that perception is different and never twice the 
same: 

P^Rp/R. Pi;^P2^P3. PRe1'^PRe2'^f Re3 • A^^gMg 

The content, the structure, the context and the format 
influence the viewers ability to perceive the picture. There is 
every reason to assume that the various picture vaiiables play a 
very important role in our ability to read and understand pictures. 
A picture which is easy to comprehend provides good learning 
and m.emory retention. This makes it a better representation than a 
picture which the viewer finds difficult to comprehend. 

So the task of the information producer is to select a 
representation in such a way that perception of the representation 
is optimized. This is a task with many different dimension.s. 




Pettersson's 1982 communications model. 
T = Time and stages of development 
Ss Cultural and social status 
Si = Sensory impression 

Cp = Cognitive processes such as intelligence and creativity 
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Communications are successful when a receiver compreherids 
the message a sender has wished to convey to him or her. 
People are being exposed to an increasing volume of "messages" 
from many different senders. The messages are transmitted from 
senders to receivers with the aid of different media. In all 
communications (even in masscommunications), many 
individuals are the recipients of the messages. 



Media and representations 

In the 60's the famous media expert professor Marshall 
MacLuhan coined the expression "The Medium is the Message". 
This expression has given rise to considerable confusion. Now, 
in the 80's, it is often said "The Message is the Medium". 
Technology is the servant, and the message, the idea, is the 
matter. This is said to be demonstrated by the fact that in 1980, 
for every dollar spent on A-V equipment, there were nearly three 
dollars spent on A-V software. However, the medium is not the 
message. A medium is an aid used in the transfer of information 
from a sender to a receiver. 

The term aid is used here as a collective designation for the 
channel, or information carrier, and the processor/equipment 
required for encoding and decoding the information. 

An information carrier is the material which carries the 
information, such as paper, plastic, film, electromagnetic waves, 
magnetic tape etc. 

The term information refers to content, message, knowledge 
etc. Information can be moved from one place to another and 
stored in analog or digital form. 

There are different types of media. Each has its own 
panicular properties, advantages and disadvantages. 

Our existing media may be classified according to several 
different criteria. (See Media-industry mapping.) 

A general principle of hum.an communication is that the 
likelihood of successful communication increases when a concrete 
reference is present. In the absence of the actual thing, the next 
best reference is a visual representation of the thing. A visual is 
more pertinent reference for meaning than the spoken or written 
word. Visuals are iconic. They normally resemble the thing they 
represent. 

A medium plus its contents is a representation (or even a re- 
presentation) of reality. Representations of reality can display 
varying structures, consist of a number of different components 
and be related to one anotherher in different ways. Words and 
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visuals, sound and visuals or sound, words and visuals are 
examples of components which can interact. 



Sender 



Receiver 




Representation 





A representation is a medium plus its message/content. 

A message/conient with a given design/form is conveye^ by 
the sender to the receiver with the aid of a medium.The various 
media are undergoing comprehensive (technical) changes, 
changes in terms of production, duplication, stock-keeping, 
distribution or presentation of contents. Some of these 
developments are proceeding in the same direction and working 
together. Others are on separate paths. Some are even counter- 
acting one another. 

Visuals used in instructional message design are usually 
representations of our external reality. However, fine arts are 
sometimes representations of our inner reality, such as thoughts 
and dreams. 

In a redundant relationship y the same information is conveyed 
via e g words, sound and visuals and is therefore "superfluous'*. 
For example, subtitles can be added to a TV program so the action 
displayed on the screen is described by the words. This greatly 
enhances the educational impact of the program. A redundant 
relationship should be used in instructional message design. 

In a relevant relationship, the information presented via e g a 
text or sound supplements the information supplied in the visual. 
Visuals with a relevant relationship to a spoken or printed text can 
greatly enhance the text's informative effect and vice-versa. 

In an irrelevant relationship, the information presented in 
various channels is completely independent of one another. In TV 
programs, for example, the picture sometimes deals with one 
aspect, the text with another and the sound with a third. This 
makes it harder for viewers to make the most out of the 
programme. 

Conflicts readily arise between a concrete visual event and 
abstract verbal information. When this happens, the concrete, 
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readily accessible information assumes priority over the abstract 
information. 

A contradictory relationship exists when the information in 
various channels conflicts. This is disastrous for an informative 
programme. 

Different media are capable of representing reality with 
varymg facility owing to differences in their structure, the kind of 
representation involved and the content. The text (both spoken 
and wntten) is an example of a "one-dimensional" representation. 
It "flows" in a relatively fixed and often unambiguous form along 
a time axis. A still picture is "two-dimensional". Its interpretation 
is less constrained. A still picture can be interpreted in more than 
one way. We extract differing parts of the available information in 
It each time we view it. A stereo picture adds a third "dimension". 
Having a "one-dimensional" and "two-dimensional" repre- 
sentation at ^the same time, or even "one-dimensional", "two- 
dimensional" and "three-dimensional" representation, at the same 
time is possible, even commonplace. In the future media also 
might be capable of representing smell which would add still 
another dimension. 

Different media are also related to one another as regards their 
level of structural complexity. The simplest form of 
onedimensional" representation is a simple acoustic signal, such 
as a baby's cry. A higher degree of complexity is found in texts, 
interactive texts or dialogi^e, monophonic music, stereophonic 
music and stereophonic radio theatre with sound effects. If text is 
likened to a flow along a time axis, then music can be likened to a 
multitude of streams fiowing along the same time axis at the same 
time. 

Music is always structurally more complex than text but can, 
of course, be very simple in content. The greater the degree of 
structural complexity, the closer the representation approaches 
reality at a given time, in a given place and in a given context. The 
table below is an attempt to describe my view of the 
interrelationships of various media in a twodimensional represen- 
tation of a multidimensional reality. 

The sender, like the information receiver, can be a person, a 
group, a company, an organization or an authority. A distinction 
is often made between private media, group media and mass- 
media. Each medium has its own particular properties. The 
selection of a suitable medium is important when informative 
material is to be produced. 
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Tafeteaa showing the relationship of various media to structural complexity and 
to different types of representation. 
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Pivduction of need- oriented mfortnadon 
When producing informaticn for instruction, education or any 
other reason we have to choose between different representations 
and between different media. Which representation would be best 
then? That question has many answers related to the needs and to 
the objectives. There are vast differences in a person's needs 
when s/he seeks information, general knowledge, diversion, 
entertainment or leisure. 

For entertainment and leisure, representations close to reality 
might be good choices. For instance it could be exiting to "walk 
around" among the actors in a holographic film in stereo and 
realistic color. For information and education, too much realism 
in the representations would make it difficult or even impossible 
for the viewer or learner to identify the essential learning cues. On 
the other hand, too little realism would also be poor choice. The 
information is inadequate. A moderate amount of carefully 
selected realism gives the best learning. Thus, a series of slides 
could be a better choice than a f»lm in a specific learning situation. 
In addition a few slides only xst a fraction as much as an in- 
structional film to produce. 

When a need for information 's identified, the need can be 
satisfied as listed below and shown in the next figure. 

- Carry out a problem analysis and find out what the problem 
really is and to whom it is a problem. Identify the 
characteristics of the receivers of the information. 

- Carry out an analysis of the information requirement and find 
out just what the information is to cover. 

- Frame the objectives as specifically as possible and express 
them in measurable terms. 

- Select a suitable method and determine in which v/ay or ways 
the objective should be attained. 

- Select a suitable medium or identify which media are to be 
used. 

- Prepare an outline of the contents. This will clarify the 
structure. The information production can then begin. Select, 
modify or design new materials. 

- Distribute the completed material to the users. 

- When the users utilize materials collect information on results 
and useful-ness 

- Test can result in th :orrection of the information, correction 
of the method and cnoice of medium and identification of new 
information needs. In the later instance, the entire cycle is 
repeated. 

As far as the choice of medium is concerned, regard must be paid 
to the suitability of various media in every individual case. To be 
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successful the sender has to know the medium and its unique 
possibilities. Advantages should be utilized. Disadvantages 
should be avoided. A comparison of the media using the "check- 
list" belov/ may make it easier to determine a suitable choice. 
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Media consumption 



Our media consumption will vary considerably depending on 
several different factors such as: 

- cultural differences 

- socio-economic factors 

- individual interests, which may cause large differences even 
between persons in the same family 

- different needs of education, entertainment and information 
during various periods in a persons life 

- different usage of the media at home, in school and at work 

- costs 

- technical developments 

- ease of use 

- competition with other activities, and 

- competition with new media 



Consumption 




Examples of different media-consumption-profiles 

In the industrialized, European cultural sphere, we are today 
living in mass-media societies. Every day we are bombarded with 
information via the media, at home, in school, on the job, and in 
the society in general. It is rather hard to avoid information and 
just as hard to obtain the "right" information, the information that 
we need at the right time. Audio, text and visuals compete for our 
attention. It is possible that we miss the information in which we 
are really interested. In addition to radio, TV, bocks, newspapers 
and magazines vast amounts of information are distributed in the 
form of letters, advertising throwaways, posters, placards, 
stencils, photocopies, photographs etc. We may "drown" in this 
"information flood". 

Already well established media will meet a lot of competition. 
Will people read books in the future? Will people listen to radio? 
To follow the development the Swedish Broadcasting 
Corporation's Audience and Program Research Division 
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(SR/PUB) conducts an annual survey on the way in which 
Swedes utilize different media on "an average day". As it turns 
out people spent an average of more than five hours a day on 
mass-media consumption in Sweden. However, there is probably 
some overlapping in the figures. Other studies have shown, for 
example, that radio listening is largely a passive occupation. 
People sometimes listen to the radio while simultaneously reading 
a paper, for example. There are also wide individual differences 
in people*s consumption habits. Five hours a day for mass-media 
consumption is anyhow a considerable amount of time in view of 
the fact that most people also hold down jobs, entailing time- 
consuming travels back and forth to work and that they sleep 
anywhere from seven to len hours a night. The average hours per 
day and night spent on major activities by the urban US 
population in 1975 were as follows: sleep 7,8; leisure time 5,5; 
work for pay 4,6; personal care 3,1; and family care 2,9 hours. 

North American children may spend 1 1 500 hours in school 
during the period five to eighteen years of age. During the same 
time they watch TV at an average of 15 000 hours and listen to the 
radio, records and cassettes 5.000 hours. In the US people watch 
TV 31 hours a week and in Sweden 12 hours and 50 minutes a 
week. The corresponding figure for reading is si\ hours and six 
and a half respectively. 

Media market size 

We can hardly talk about or define one single media market. 
Instead there is a vast amount of specialized markets or market 
segments. These are dependent on factors such as: 

- populations and demographic data 

- geographical and political situations 

- cultural and socio-economic factors 

- languages 

- trade and customs regulations 

- the information economy 

- technology trends 

- different user groups and needs 

- hardware, equipments and services, sales, rental 

- software, production, distribution, sales, rental 

- the chicken and egg problem. 

A specific market may be considered very large for one medium 
but at the same time minor for another medium Obviously the 
characteristics and the economics of different media are extremely 
different. It may be worthwhile to produce a newsletter on an on- 
line database-service for a few hundred subscribers but not 
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possible to produce a spectacular superstar movie for le^s than 
millions of viewers. 



Possible net profit per copy (receiver) 

r 



10.000- 
1000- 
100- 
10- 

1- 

0.10- 
0.01- 



Report from 
consultant 



Special 

database Software 



News- 
letter 



Book 

Record 

Movie 

Magazine 

Newspaper 



-4- 



-f- 



i 1 1 1— 

1 34 10 10^ 10^ 10 10 10^ 10^ 10^ 



Number of receivers 
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The activities needed to enhance the possible net profit per copy are 
different for various groups. For private media a solution may be to 
get more customers. For mass-market media the producers should 
get better margins. 
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It might be forecasted that the information economy takes an 
increasing part of the total economy in the future. 

As an example the total audio-visual software market was 
USD 2.45 billions in 1982, USD 2.90 in 1983, USD 3.28 in 
1984 and more than USD 4 in 1986. The world electronics 
market was USD 48 billions in 1966, USD 154 in 1976 an 
estimated at USD 480 in 1986. 



Finance and business markets 

Time critical services demand '*real-time" communication. They 
may be available on demand or include an alerting service. 
Typically these services will be concerned with financial matters 
such as stocks and shares, commodity trading, etc. 

Non-time-critical services will include a series of browsing 
and alerting services similar in purpose to newsletter-type 
publications. They may be supplied by such media as videotex, 
teletex, electronic mail, audio tape and digital discs. 

In-house publications such as manuals can be expected to be 
increasingly presented in electronic form, with greater interactivity 
and also quality of reproduction and presentation. 



Professional markets 

These markets have restricted and selective applications and 
specialized subject areas. Services are likely to grow out of 
existing requirements in answer to specitic needs and will include 
provisions of specialist information and data, fast updating, 
current awareness, software packages, complex information 
retrieval and research dissemination. The services may be 
provided by commercial umbrella information providers, profes- 
sional organizations, or commercial publishers, and are likely to 
be mounted on host computers accessible via telecommunication 
networks, or supplied on portable machine readable files such as 
tapes and discs. 



Education markets 

Electronic media have a number of features which are important to 
education markets. One of the most important is the degree of 
interactivity which is offered between the teaching material and 
the user. Others include the variety of media and the ability to 
deliver the material where and when it is required. 

Electronic media must be expected to provide an increasingly 
important supporting role. Typical services and products will 
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include books with machine-readable sections, modular material, 
audio tapes and discs, video tapes and discs, mixed media 
productions, personal computer software, authoring languages to 
enable teachers to prepare their own material, and on-line 
computer-based training. 

In further education distance learning facilities are important. 
These will be provided by programmed learning and fault finding 
routines, computer-based learning, television programmes linked 
to other facilities such as software, simulation exercises and tele- 
conferencing with tutors. 



Consumer and leisure markets 

One of the key marketing concepts in new media is to create 
products which will stimulate consumers into buying or renting 
the necessary hardware. The organization and networking 
facilities will differ fi'om country to country. 

Local or regional news and information services will emerge 
covering news stories, travel information, guidance on local 
authority services, advertising, entertainment, shopping etc. 
Relevant media are videotex and cable tv. 

Magazine-type services will focus on a collection of related 
topics and include information, entertainment and advertising. 
Key features will be segmentation of the market, e g according to 
demographic or user needs; use of sound and moving pictures as 
well as text; creation of several products on the same theme but 
using different media; creation of multi-media products; co- 
production with several types of organizations and sponsors; new 
ways of handling advertisements. Appropriate media will be 
videotex, cable tv, video tape, video disc, and magnetic and opti- 
cal media for use with personal computers. 

Computer games can be regarded as the leading edge in 
consumer displays and consumer involvement. The media which 
will be used include audio cassettes, floppy discs, plug-in 
memory, video tape, video discs, optical disc and card, videotex 
and holograms. 



Media-^industry mapping 

Several attempts have been mad j make different kinds of 
"maps" or "models" of the media-industry. These maps might be 
useful as tools for strategic planning for the information business. 
It is by far not easy, or even possible, to make one single map 
that covers all aspects of the media-industry. Thus we have to 
work with a set of different maps at the same time. Such maps 
have been produced according to different criteria such as the 
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needs of the users, time of delivery and number of receivers, 
growth of the information business, media evolution, and tech- 
nical development (several other possibilities may still remain). A 
few systems will be briefly presented here. 



Needs 

We all have individual feelings towards media. Our media 
consumption is depending e.g. on factors like our interests and 
our perceived need for education, entertainment, information and 
news. Our need for education, entertainment, information and 
news can be visualized as areas partly covering each other. 
"Double'* areas are the subject of special interest tor publishers 
since these areas are most Ukely to attract more attention fro.n 
consumers than other areas. It might even be possible to produce 
for example a television program with elements covering all these 
needs. An example of such programs is the BBC series about the 
life on earth by and with naturalist David Attenborough. 




Infocatlon 



A need-oriented media map. 

Time of delivery and number of receivers 

We have "fast" and "slow" media. We have "personal", "group" 
and "mass-media". If we mark different media on a "Time of 
delivery and number of receivers"-map we can see where we are 
today and find possible new segments for development. The 
"blank" area on the map is gradually being f/'ed with videotex 
and other new tele-communications media. 
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Number of receivers 

TlfTiG of delivery and number of receivers media map. 
The information business map 

At the Harward University Center for information Policy 
Research "the information business map" has been developed. 
The niap ^ a rectangle in which the left side range tioni basic 
products like paper and file cabinets to delivery services of parcels 
and nail. The bottom side of the map range from the plain paper 
to books. In the upper right corner we find financial and 
professional services. Thus all kind of products and services 
related to the information business are placed on the map 
according to their conduit or content. The map is strikingly nice to 
look at. However, in my personal view, this model is not very 
easy to use in the practical work. 



Media evolution 

Existing as well as future media may be mapped according to an 
evolutionary aspect During many years the media-situation has 
been very stable, only expanding a bit year by year. During the 
1970'ies video developed into a competitive medium. At the same 
time the classical 'borders" between the media-groups begin to 
loosen. In 1982 several new technologies, most based on 
computers, as well as completely new media are developing. The 
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borders loosen even more and in the future most media will 
interact and partly overlap each other. 




For many years the media situation has been very stable, only expanding a little 
each yoar. In the 1970's video developed Into a competitive medium. At the 
same time the classical "borders" between the media groups begin to dissolve. 
In 1982 several new technologies, most based on computers, and completely 
new media began developing. Demarcations are even less pronounced today, 
and most media will interact and partly overlap each other in the future. 

Live media include: 

Personal communication personal body language, speech 

Group communication social body language, ballet, pantomime, 

theatre, live music,conference, church, school 



Graphical media can be put into two groups: manually or 
personally produced; and manufactured media. 

The manually produced graphical media include pictures, 
such as drawings, paintings, etchings, lithographs, signs, and 
text such as letters and handwritten manuscripts. 

The manufactured group of graphical media has a wide range 
of products or services, as shown below. 
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Graphical media may be used for enieriainmeni/recreaiion/enlighimeni, 
information and education/ instruction. They have all their different 
characteristics. 



Products 
1 Serials 



2 Books 



3 Printed music 

4 Maps 

5 Separate 
pictures 



Characteristics 
several timc$/week 



numerous times/year 



Examples 

morning papers, evening 
papers, business publications 

weeklies, comics, trade jour- 
nals, professional journals, 
scientific journals, newslett- 
ers/bulletins 



periodical publications year books, almanacs, catalo- 
gues 



reference 



non-fiction 



school and college 
textbooks 



fiction 
comics 

children's books 



two-dimensional 



lhrcc-CLi.:ensionaI 
6 Printed matter for disirib ution 

for display 



dictionaries, directories, 
lables,encyclopaedias, 
statistics, indexes 

handbooks, biographies, travel 
guides, monographs, 

teachers' manuals textbooks, 
workbooks, programmed in- 
struction 

novels, anthologies of essays, 
poems 

comic books 

baby, infant, teenage 

sheet music 

atlases, gazetteer, wall maps 

reproductions, posters, post- 
caixis 

autosiereo, chromic stereo 

booklets, brochures, reports, 
lists, manuals, circulars, bags, 
printed articles 

signs, menus, posters, 
dccals, pamphlets. 
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7 Security prim 

8 Copying 

9 Computer media 



bills, shares, bonds, lottery 
tickets, coupons 

electrostatic, diazo, thermal 

computer printouts 



Sound media can be put into four groups based on the ways 
they can be used and the technology involved as shown below: 



Products 
1 Records 



2 Audio tape 



Characteristics 
rotating disc with mechani- 
cal pickup 

rotating disc with optical 
pickup 

fixed disc with mechanical 
pickup 

soundwdre 

tape in open spool 

compact cassette 



Examples 

long playing record 



compact disc 
TAI-minidisc 



Philips standard 
audio cassette 



3 Sound card 



mini cassette 

cassette with endless loop 

film base with magnetic layer line reading 



4 "Firm* memory printed coding EAN-coding 

computer speaking toys 

(speech synthesis) speech output 

photographic audio disc digital hi-fi 



Models and exhibitions offer a means of expression which is 
more accurate than many other media. Increasingly these can be 
seen to provide a total ^experience'. Different types and 
applications are shown below: 



Products 
1 Models 



Characteristic 
three-dimensional 



Examples 

sculpture, modelled items, globe, 
diorama 
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multidimensional 

2 Exhibitions fixed: 

two-dimens»onal 

three-dimensional 

multi-dimensional 

moving: 
two-dimensional 

three-dimensional 

multi-dimensional 

3 Holograms fixed hologram 



robot, happening & events, 
simulation 



exhibitions with pictures and text 
pictures, text, sound, objects 
moving pictures 

exhibitions with pictures and text 
pictures, text and sound, objects 
moving pictures 

transmission-, reflex-, dichromatic 
holograms and hologram with 
projected picture 



moving hologram integral hologram, hologram film 

Film media may be two- or three-dimensional, still pictures or 
moving pictures. 



Products Characteristic 
A Two-dimensional 
I. Still pictures non -silver based 



Examples 

overhead transparency, 
slides, microfiche 

silver based overhead transparency, 

slides, microfiche, panoramic, 
film strip, microfilm 

2 Animated pictures dynamic picture overhead with overlay 

picture with movement overhead with movement 
multi-projector show 

3 Semi-moving programfilm 



4 Moving pictures school and training 
films 

movie theatre 



multiple projectors 
PiP(S-8), Bezeler(l6) 
single-concept, S-8, 16 mm 



16 mm, 35mm, widescreen 
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B Three-dimensional 

5 Still pictures viewmaster, auiostereo, 

chromatic stereo, 
polarized light 

6 Moving pictures chromatic film, polarized light 



Broadcast media include both audio and audio video services. 
Examples are shown below: 



Services 
1 Radio 



3 Data 



Characteristics Examples 
broadcast national radio, local radio, narrow- 

casting, cellular radio 

communications radio alarm, military, police, civil 



2 Television sound and picture 



3D -TV 



television, local TV, 
narrow-casting TV, 
interactive cable TV, 
closed circuit TV, 
direct broad-casting by satellite 

chromatic 

teletext 



Video media provide a high level of information content in a 
simple to understand form. Many of them include audio 
information. Because of the need to store a lot of information a 
major characteristic is compactness of storage. Major examples 
are shown below: 



Products 

A Still pictures 

1 Videotape 

2 Videoshcet 

3 Video discs 

4 "Firm' memory 



B Moving pictures and sound 
1 Videotape open spool 

video cassettes 



2 Video disc long-play 



Characteristics Examples 



compact-cassette 
Mavica 

optical pickup 
pictures 



1/2 in, 1 jji, 2 in 

angular search (U-matic,VHS, 

Beta, V-2000), 

Compact cassette (8) 

longitudinal search (BASF, Toshiba) 

mecanical (TeD) 
magnetic Disc (MDR) 
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interactive 

3 "Firm' memory 

4 3D TV 



optical reflective disc (LaserDisc) 
optical transparent disc 
(Thomson CSF) 
capacitative disc without 
groove(VHD) 

capacitative disc with groove 
(SelcctaVision) 

optical reading (Laser Disc, 
Thomson CSF) 

video games 

polarized light 



Telecommunications media are able to transmit a wide 
variety of information, examples are: 

Products Examples 

1 Sound telephone conversation, teleconferencing, dial-up 

services, voice mail 

2 Text telegram, telex, teletex, facsimilie, mobitex 

3 Pictures video teleconferencing, facsimilie, TV-pictures 

4 Data datel, datex, telepak, teleshopping,telebanking, 

telesoftware, videotex 



Computer media may be found as parts of the other groups, 
especially in the telecommunications group. Examples are: 
computer print-outs, computer programs, computer conferences, 
artificial intelligence, computer games, CD- ROM, CD-I and 
Laser cards. 



Technical development 

At present we can see a tremendous lot of work being done in 
technical laboratories all around the world. In the coming decades 
this will result in new techniques to produce traditional media as 
well as in new media and in different kinds of new services. 
Especially interesting is the development of integrated digital tele- 
networks capable of transmitting sound, text, data and pictures at 
the same time and in the same system. Various "technical 
development maps" or "time-scales" exist in different parts of the 
world. 
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New media 



The amount of information being disseminated is increasing with 
un- paralleled rapidity. At the latest turn of the century there were 
about 10,000 technical and scientific journals in the world. By 
1970 the number had grown to 100,000, and this number is 
expected to increase tenfold by the year 2,000. One study 
estimated the 1980 consumption of forms in Sweden at 6,000 
million, i.e. about 750 forms per person. The amount of 
documents being filed in the public sector alone is growing at a 
rate of 40,000 meteis of shelf space each year. The same trend 
has been valid also for private enterprise, not only in Sweden but 
also in most other countries. By now no signs indicate a paper- 
less society, maybe a "less paper" society. Video discs, cable TV, 
satellite transmissions, videotex, computers and other new media 
are due to increase the flow of information to even greater levels. 

Since several years digital storage of more than 50 TV images 
is possible on an ordinary compact audio-cassette. Other systems 
are much more efficient. Fifty color pictures can be stored with 
very good quality on one A6-size microfiche (10,5 x 14,7 cm). A 
stack of microfiche, 1 cm thick, can store more than 1,000 
frames. However, a video disc with optical reading is capable of 
storing the text contents of 500,000 A4-size pages (21 x 29,5 cm; 
10,(X)0 million bits of information). Data are recorded by a laser 
beam which bums microscopically small holes in a disc. The disc 
is then read by a semiconductor laser and the information is on 
demand displayed on a CRT tube. Other optical video discs can 
store 90,000-100,000 stills for the TV-screen. A TV-image today 
consists of about 250,000 image points or picture elements which 
vary with respect to the gray scale and to the color information. It 
is possible to retrieve and display any one of these stills in a 
matter of a few seconds. 

For several years now some people in Sweden have 
anticipated or feared an increased dominance by television 
because of satellites, cable-TV and videograms. In the US every 
second household did even in 1980 have two TV-sets, and more 
than one set is normal in households with at least three members. 
In Sweden this is not yet the case but it is becoming more and 
more usual to have more than one TV-set in the household. In the 
future, digital techniques will be employed in the recording as 
well as the editing and distribution of TV-programs. When digital 
techniques will be introduced, a common world standard will be 
possible. Then the problems caused by the different TV-systems 
in use today, NTSC, PAL and SECAM, will disappear. This will 
indeed facilitate international distribution of programs. However, 
in 1986 there were about 600 million TV-receivers in use in the 



33 



ERLC 



world and the electronics industry is set up to manufacture 
conventional TV-sets. That means that it will take some time 
before the new technique will be in common use. 

TV-screens might become the "spiders in the communication 
webs of the future". Ten years ago there was only conventional 
broadcast television. Since then, however, a dozen different 
functions have been or are being introduced. So the TV-set will 
play a major role in the "pushbutton society" or rather the "voice 
recognition society" of the future and will only be employed to a 
limited degree for displaying traditional broadcast programs in the 
1990*s. This will heighten demands for more TV-sets and for 
large, flat color-TV-screens with stereo sound. 

During 1981 the Japanese Sony Corporation presented a new 
"High definition video system" which is said to give the same 
picture quality as an ordinary 35-mm film projected on a screen. 
The system operates with 1 125 lines and one million image 
points which vary Vy.^h respect to the gray scale and color 
information. Thus this system is about four times better than the 
present TV systems. 

During 1983 1MB presented a 50 x 56 cm flat plasma screen 
with 750 horizontal and 1,000 vertical pipes which makes 
750,000 image points. The screen can display 9,920 characters 
and can be divided into maximum of 16 separate parts. Behind the 
screen is a microcomputer with a memory of 24,000 characters. 
Several other companies are also working on improvements of 
screen quality. 

At Tsukuba Expo-85 in Japan several new screens for TV- 
images were presented. It was possible to view an 'mage on an 
about four square centimetre writch watch television and at the 
same time see the same image on the Sony Jumbotron with a 
screen one thousand square meters large. 

Current laser techniques make it possible to create three- 
dimensional images, holograms, enabling viewers to see "behind" 
image objects. These techniques are at about the same stage of 
development as photography was at the beginning of the century. 
Many people are aware of the dramatic developments in 
photographic and film techniques since that time. The develop- 
ment of holography will be equally dramatic, although more rapid 
in coming decades. 

Studies in Japan have shown that the ratio between "utilized" 
and "available" information has fallen from about 40% in 1960 to 
about 10% in 1975. So 90% of available information was 
"wasted" from the sender's point of view. Today, the figure for 
"wastage" is probably even higher. We are rapidly heading for an 
information oriented society characterized by a need for selectivity 
in information consumption tailored to our individual needs 
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instead of to the availability of large amounts of general, mass- 
produced/copied information. Computers with routines for 
intelligent searches of large amounts of information can be very 
useful and are probably essential. 



Electronic Publishing 

At the end of the I960's the "electronic revolution" was 
announced. The book was said to disappear and would very soon 
be replaced by new electronic media like video cassettes. During 
the first years of the 1970's publishing houses throughout the 
world were hit by severe crises followed by necessary re- 
organizations. At that time some people saw only threats. Others 
could see that the development of new media also could mean 
new opportunities as well as new risks. After more than 500 
years the printed word is still alive and will certainly be so for a 
long time but together with other carriers of information and 
partly in other formats. We will experience "on-demand- 
publishing" when only the information needed at one specific 
occasion is copied or printed, for example by a laser printer linked 
to a computer. Most of the information needed can be read on the 
screen and might never be printed as a hard-copy. 

In recent years, the concept "electronic publishing" has come 
into increasing use. However, the concept is not really very good. 
Like "traditional publishing", "electronic publishing" is far too 
vague, comprehensive and ambiguous. Traditional publishing 
comprises publication of e.g. books, newspapers, magazines, 
maps, films and AV material. Electronic publishing comprises the 
following media/forms of distribution: 

1 Traditional ether inedia. Ix)cal, neighbourhood and network 
radio and TV. 

2 Special transmissions." Cable TV, pay-cable TV, coin- 
operated TV, satellite TV , viewdata, home fax. 

3 Videograms and phonograms. Video cassettes. Video discs, 
audio cassettes, phonograph records. 

4 Databases. On-line databases (e.g. a computer with floppy 
disc). 

5 Future media . "Electronic holograms" etc. 

So publishing can comprise many different media with 
different properties and requirements. We should therefore try to 
express ourselves with greater stringency when discussing the 
subject of electronic publishing. 

In Sweden private information producers cannot work with 
tiaditional broadcasting of radio and television, nor with cable 
televlcion accoming to the present laws which give monopoly to 
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state controlled broadcasting, The Swedish Broadcasting 
Corporation (Sveriges Radio). In 1978 the corporation was 
reorganized into four independent subsidiaries, one for television 
(national and regional), one for national radio, one for local radio 
and one for educational broadcasting. The overseas service, 
Radio Sweden, beams short-wave and medium-wave pro- 
grammes in different languages. 

The parent company is responsible for allocating the financial 
resources and co-ordinating long-range planning and development 
for the group. Agreements between the government and the 
broadcasting companies entitle the latter to determine their own 
programme policies, free from outside pressures and censorship. 
The companies shall furnish the public with a broad range of 
programmes appealing to different tastes. Output has to be 
impartial and balanced. The annual budget for broadcasting is 
appropriated by Parliament. The system of television licence fees, 
which finances programmes (except educational broadcasting and 
the overseas service), is also controlled by Parliament. 
Commercial advertising is not allowed on either radio or televi- 
sion. Thus, the media situation is very different in Sweden than 
for example in the US. New media like video, teletext and 
videotex have and have had extraordinarily good possibilities of 
developing in Sweden since the society is not "overloaded" by 
broadcast media. 



Video 

Videogram is a collective designation for video cassettes and 
videodiscs, i.e. media for the storage and replay of TV programs 
at an optional time and place. The utilization of video cassettes can 
be said to comprise three main fields: 

1 the recording of transmitted programs for subsequent replay. 

2 distribution and rental or sale of pre-recorded programs, such 
as movies for entertainment and education, and 

3 program production. 

In 1980, there were no fewer than 70 different companies 
world-wide which manufactured 195 different kinds of video 
cassette recorders (VCR). There were about 50 different systems 
for video discs. Most of these systems lack any real practical 
significance. But the numerous "major" and widely distributed 
systems often create practical problems for users since these 
systems are not compatible and the incorrect type of cassette or 
disc could be purchased. 

In the beginning of the I970*s expectations were high, 
especially in the electronic industry and from many producers of 



36 



3G 



programmes. However, changes in patterns of behaviour are 
often slow. It takes time to develop a new medium. 

For a number of years video developments progressed very 
slowly because of factors such as the multiplicity of incompatible 
technical systems, i.e. a cassette recorded according to one 
system could not be played on a VCR using another. Nor were 
the earliest VCR's particularly reliable. Playing time was also 
limited, in general no more than one hour. Modem cassettes have 
playing times of several hours. One critical requirement was a 
need for 90 min of uninterrupted playing time so a whole movie 
could be run with no need to turn the cassette. 

The sale of video equipment in Sweden was sluggish in the 
beginning with only a few thousand units being sold annually. 
However, the use of video cassette recorders increased sharply in 
1979/80 when it became possible to hire movies, especially after a 
Swedish TV program on video violence (Studio S on December 
2, 1980). According to people in the trade, this date marks the 
birth of the video rentals business in Sweden. 

At the beginning of 1980 there were 60,000 video cassette 
recorders in Sweden. The number more than doubled during 
1980 and doubled again 1981 to reach some 300,000 at the 
beginning of 1982. At mid 1984 there were 600,000 video 
cassette recorders in Sweden, about 18% of the Swedish homes. 
Video viewers spent an average of 95 to 100 minuter a day 
viewing a VCR program. The Commission of Videograms 
estimated in their final report. Video (1982), that by 1985 there 
will be somewhere between 800,000 and 1,5 million video 
recorders in Sweden, representing a penetration of between 25 
and 40% of homes with a TV set. In December 1985 the actual 
figure was 825,000 (23 %.) A year later it was 960,000 (29,3%.) 
and two years later more than every third household had video 
cassette recorders. 

Regarding sales of equipment the situation was similar in 
other countries. In 1980, 820,000 VCR's were sold in the U.S. 
750,000 in Japan and 720,000 in Europe. At the end of 1980, 
there were about 8 million VCR's in the world. Forecasts for the 
I980's point to high-volume sales. By 1986 the actual sales had 
reached 134 millions. 

The Swedish Videogram Commission submitted its report 
"Video" in the beginning of September 1981 after four years of 
work. Among other things, the Commission found that 
videograms could not be studied apart from other media. Satellite 
TV programs and cable TV could quickly create a new media 
situation. ''Governmental measures'* will be required, the 
Commission felt, to ensure that a wide range of good quality 
video programs is available to the public. Swedish TV programs 
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in the form of videograms should be widely distributed, e.g. via 
the library system, the Commission report noted. Since 1982, the 
Swedish Educational Radio Service has been running a pilot 
project invoh ing the loan of video cassettes at the Luna library in 
Sodertalje. In iht new film agreement, two million Swedish 
kronor (Skr) were allocated for pilot projects involving alternative 
viewing forms for films and TV programs. A broader based pilot 
project utilizing the folk libraries might be started. The 
commission report listed the following proposals (p. 174) on 
"educational matters:*' 

"Our basic knowledge on the way people are influenced by 
pictures should be expanded. The utilization of pictorial 
illustrations in e.g. elementary school textbooks has been 
critici3,ed. Research into the composition of didactic pictures has 
recently started in Sweden. So the assignment to the UHA should 
also comprise increased efforts in research and educational 
development work in the picture field. Here, special met- hods 
will be required in regard to the use of general TV and video pro- 
grams. Experiences gained in Sweden and abroad should be 
incorporated." (UHA=National Board of Universities and 
Colleges). 

According to a study made 1981 within the Swedish 
Broadcasting Corporation video recorders are primarily used for 
time shift. During one week 75% of the programmes viewed in 
homes with a video player had been recorded off the air. 
However, die commercial video market is growing rapidly. There 
were some 600 titles on the consumer market 1980, over 2,000 
titles 1984 and 3,000 titles 1986. The three main wholesale 
dealers rented videograms to their local agents for 7 M crowns in 
1979/80, 60 M crowns in 1980/81 and about 170 M crowns 
1981/82. Distribution of rental programmes is very well 
developed with more than 1,000 outlets in 1980. 

In Sweden with a situation in which criticism of Swedish 
Broadcasting Co. TV programming is mounting, it is natural for 
new media like video to attract a public longing for entertainment 
and leisure. 

In other countries with more TV-programming, cable- 
television and also satellite-television the market for video will 
probably not be as good as in Sweden. Video is not likely to 
compete with books and newspapers but ratlier with television. 

Videodiscs offer new possibilities. As mentioned earlier an 
optical video disc can store 90-109,000 stills to be presented at 
random on a TV-screen. It is possible to retrieve and display any 
one of these stills in a matter of seconds. Interactive videodiscs 
will offer great possibilities for e.g. education and information. It 
was already in 1980 possible to run a video disc player by the 
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commands from a personal computer. The possibilities to produce 
adapted and individualized programming is almost unlimited. The 
possibility to have e.g. all the paintings from the most famous 
collections in the world in all museums and all libraries is 
thrilling. 



Teletext 

For the past 15 years, experiments have been conducted in 
different parts of the world m which certain information stored in 
computer systems can be accessed from the home, company, 
agency, school etc. The simplest of these experiments is teletext, 
sometimes called broadcast or one-way videotex. It is a one-way 
system for transmitting data from a data-base to TV sets with 
built-in decoders A TV set with a teletext capability costs only 
about 1,000 Skr more than the corresponding unit without a de- 
coder. The disseminator of information is able to reach several 
million sets with a limited number of messages (i.e. a few 
hundred "pages"), but these messages can be updated continually. 




Teletext. 
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Teletext pages art transmitted by broadcasting or cable and 
viewed at any time. The digital data signals are stored on lines not 
utilized to form the ordinary TV image. An accessory with 
pushbuttons is used to "browse" until the desired information e.g. 
a newr, summary, weather forecasts or sports results is found. 
Waiting time in a teletext system comprising one hundred pages 
varies from a tenth of a second to 15 seconds with a mean of 
seven and a half seconds. When an entire channel is committed to 
teletext - which is easy in a cable TV network covering a total of 
100 channels, the data base could hold up to 50,000 pages. 
Waiting time would then not exceed 30 s. Separate channels for 
teletext are currently being considered in countries like Japan. 
Such channels could be used for educational purposes. 

Teletext might develop into the TV-newspaper the future 
with news as the most important programming. The role of daily 
newspapers and disseminators of news could be saken over by 
teletext to a' ge extent. 

A number of national systems have been devised for teletext. 
Experiments and services are carried out in several countries, 
such as:Australia , Austria, Belgium, Canada, Denmark, Federal 
German Republic, Finland, France, Great Britain, Holland, 
Israel, Italy, Japan, Norway, Spain, Sweden, Switzerland, 
United States and Yugoslavia. Britain was first of the mark with 
Ceefax from the BBC (1976) and ORACLE from ITV. The latter 
is a commercial radio and TV company. 

Teletext is sometimes confused with "teletex" - minus a "t" at 
the end. "Teletex" is an interactive word processor linked to the 
Swedish data network and introduced by the National 
Telecommunications Administration in November 1981. Teletex, 
sometimes referred to as "supertelex", consists of terminal 
hardware, a teletex network, a number plan and a teletex 
catalogue. 



Videotex 

In contrast to our established media, videotex has no natural or 
clear cut niche. Many standard products and/or services are 
threatened or can be augmented by videotex. One important 
application is in the distribution of messages, i.e. electronic mail. 
So postal authorities in many countries are interested in it. 
Videotex can be regarded as a data traffic via telephone lines, so 
telecommunications and computer companies are equally 
interested. It is excellent for supplying various kinds of economic 
information. So banks are looking at i; closely. Videotex can 
currently be used to book tickets or make direct purchases of all 
kinds of goods and/or service in many countries. In the future. 
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wholesalers may be able to eliminate retailers in a number of 
different trades. Videotex can also be viewed as a kind of 
electronic newspaper and/or book, so the medium lis also 
attracted the attention of newspapers and book publishers. 
However, Videotex can also be described as a kind of 
newspaperlike TV-service offering animation and attractive image 
quality. So TV companies are looking into it. Electronic games 
have proved to be the most popular videotex feature, so video 
game companies are interested. These are only a few of the fields 
covered by videotex. There are more. Videotex allows numerous 
information suppliers to store anything from a few "pages" to tens 
of thousands of "pages" containing information in one or more 
computers. Many different users are able to conduct simultaneous 
searches for information of interest to them on any occasion. So 
salespersons in the field can always have access to absolutely 
fresh information on stocks, prices, delivery terms etc. A person 
with specialist knowledge in a particular field can offer 
consultancy service, newsletter, reports etc. - all delivered via 
videotex systems to customers in different countries. National 
boundaries are no longer obstacles to the flow of information as 
was previously the case. By means of appropriate search 
routines, users can gain access to inforp.iadon in one or more data 
bases. 

Since the signals are transmitted via ordinary telephone 
cables, the resolution of "pages" is necessarily limited. There are 
a number of different technical systems (Table 3). Most of these 
systems can transmit text and very simple pictures. This works 
fine in the case of brief texts and various kinds of tabular 
information. A "page" on a TV screen has only 24 lines with 40 
characters/line. This is a major limitation in many contexts. 
Compared to traditional graphical reproduction methods, text is 
difficult to read in all videotex systems. 

The Swedish DataVision, lik^ Prestel in England, Bild- 
schirmtext in Germany, Telset in Finland, Teledata in Norway 
etc., is a version of the same basic system and only the first step 
towards more sophisticated systems in the future. Both the 
Telidon system in Canada and U.S. and the Captain system in 
Japan are examples of systems which already offer a wider range 
of options than the Prestel systems. Digital telecommunications 
networks and digital TV sets will make it possible to use videotex 
in education. In my opinion, future videotex systems should 
display the following properties: excellent image quality, 
animation, intelligent search systems, sound and user friendly 
man-machine interaction 
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Videotex. 

The videotex field is currently in an intensive phase of 
development and the subject of growing interest. An increasing 
number of international conferences and trade fairs are being held. 
According to various sources, governments, organizations and 
different companies have already invested more than 10,000 
million Skr in the development of videotex and on various 
videotex experiments in different parts of the world. Too many 
people have invested too much money to allow the systems to 
fail. In 1984 videotex was available in Australia, Austria, 
Belgium, Brasilia, Canada, Denmark, Federal German Rep , 
Finland, France, Great Britain, Greece, Holland, Hong Kong, 
Hungary,Japan, Kuwait, New Zealand, Norway, South 
AfricaSpain, Sweden, United States and Venezuela 

An alternative to videotex is audiotex, commercially 
introduced by Dow Jones News/Retrieval in January 1984. With 
a digital telephone is it possible to comimunicate with the computer 
and have messages delivered by synthetic speech. 



Cable TV 

Radio and TV reception at many locations in North America, 
Canada in particular, is often difficult because of the terrain. So 
companies began erecting television distribution aerials (often on 
mountain tops) in the I950*s. There were no serious copyright 
problems or difficulties since the TV programs were largely 
financed by advertising and regarded as a "natural right*' by the 
public. TV distribution systems were ultimately improved. Since 
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the TV programs were distributed via cable, the system was 
referred to as "cabie TV". 

The first cables were only able to carry a single TV channel. 
But 6 to 12 channels were normal by 1970. Modem systems can 
now accommodate more than 100 TV channels. 

In 1984 there were 320 systems in Canada and 4,400 in the 
U.S. Each system had an average of 5,000 subscribers in Canada 
and 2,000 in the U.S. 90% of the Canadian homes with a TV 
subscribed to some cable TV system. The corresponding figure in 
the U.S. was 27.5% (22 million cable TV subscribers). 

The new systems offer channels only showing movies, 
sports, news, weather reports etc. in addition to the programs, 
financed by advertising, transmitted by ordinary TV stations. This 
development has become possible, thanks to new distribution 
technology. A distribution chain may comprise the following: 

A "wholesaler" who owns program rights, such as Time 
Inc.'s Home Box Office (HBO) which broadcasts on two movie 
channels (24 hours a day, 365 days a year, on Eastern Standard 
Time and Western Standard Time) from its studio in Manhattan. 
Programs are transmitted by cable to the roof of a skyscraper. The 
programs_are-then-beamed by microwaves to Long Island where 
they are relayed to a TV satellite. The signals are reflected by the 
satellite and picked up by thousands of parabolic antennas all over 
the U.S. and Canada. Local cable TV networks then operate as 
"retailers", decode and "clean up" the signals and deliver them to 
households subscribing to HBO. The "retailers" often offer 
several different entertainment channeJs without any advertising. 
Every movie is broadcast up to ten times every six months. A 
subscriber often pays about $ 7 a month for the basic service, i.e. 
the ordinary TV programs, plus an additional $ 5-10 a month for 
movies. This type of service is referred to as "pay-cable TV" or 
"pay TV". 

In the future, cable TV systems will offer two-way 
communications in the next generation of videotex systems. Since 
image quality will be superior to the quality of present TV 
systems, the limitations imposed by the "mosaic images" in the 
present videotex systems when goods, services and even 
information are ordered will be eliminated. Future cable TV 
systems will also offer extensive technical opportunities for 
advanced "remote education" programs. 



Computers 

"Home computers" is the designation for small, very inexpensive 
computers in wide use. A home computer may be connected to a 
TV set. It has an external memory in the form of ordinary tape 
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cassettes or floppy discs. Home computers are often used for 
playing video games, bui ihcy can also ht employed for ceilam 
applications in teaching. 

Scarcely any home computers were sold in Sweden in 1981. 
But sales sky-rocketed in 1982 when 50,000 home computers 
were sold. Then sales slowed down a little. Sweden belong to the 
leading computer countries in the world. In 1985 the total number 
of computers and terminals was about 500.000. This figure is 
forecasted to double by 1990. 

Many of the home computers now being sold could 
conceivably serve as terminals for videotex systems. 

The Swedish TUDIS project (an acronym for the Swedish 
term describing a method for buying computers for school use) 
defines the technical requirements for computer equipment to be 
used in schools. The National Swedish Board of Education has 
laid down its requirements for the design of hardware and 
software for Swedish schools in the PRODIS project (an acronym 
for the Swedish term describing hardware and software for 
schools). The use of computers in the school was discussed 
extensively in the PRINCESS project report,. "Computers in 
education". Teaching in computer science as well as application of 
computers began to a relatively small extent already during the 
I970's and has increased rapidly at the beginning of the 1980*s. 



Mediateques 

It is possible that our current libraries could be converted into 
mediateques in the future, i.e. places at which information can be 
sought. A mediateque could consist of a TV se^CRT display with 
decoders for teletext and videotex, a telephone plus a modem, a 
small computer with built-in memory, software for intelligent 
search routines and one or more optical video disc players. 

The computer makes it possible to "leaf" through 50,000 
stills on one side of a single optical video disc. The same disc 
could also conceivably store more than two million videotex 
images. The system could offer an interesting combination of lo- 
cal and central storage of information. Absolutely up-to-date 
information in any of the world's various data bases could 
become accessible by means of a telephone link to the respective 
computer or by connection to a computer network. More stable 
and invariable information could be stored on optical video discs, 
magnetic discs or, to some extent, on magi.etic tape. If a TV 
camera is added to the system, the user would be able to enter 
his/her own recordings of sound and moving pictures. Texts 
would be entered via the computer. A school could have a central 
mediateque with terminals in different classrooms. 



44 

ERIC 



44 




Mediateque 1 . 
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Mediateque 2. 
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The information society 

We live in a society in which the availability of and need for 
information as the basis for decision-making is continually 
increasing. We now learn a little about a great many subjects with 
the result that it is becoming easy to acquire comprehensive but 
very superficial knowledge. Our basic knowledge is also 
frequently inadequate. 

The American media economist Parker has shown that the 
labour market's traditional subdivisions have changed strikingly 
in recent decades. 

The number of people employed in the information sector has 
risen from less than 5% of all the gainfully employed people in 
the U.S. in 1860 to more than 50% in 1980. Developments in 
Sweden have probably been along similar lines. The agricultural 
and industrial sectors have been the subject of extensive measures 
to improve efficiency measures. A number of measures aimed at 
making the service sector more efficient have also been 
implemented to some extent. For purely economic reasons, the 
same-efficiency-measures will also be introduced in the infor- 
mation sector. The number of people employed here will not 
continue to rise as quickly in the future. Nor will we be able to 
increase our information consumption very much in the future. 

The information must be more effective. We must analyze the 
factors which are important to the way information is designed, 
distributed and perceived. Previously, information used to be 
produced by people who frequently only had a very vague idea 
about the objective and function of the information they were 
producing. In the future the production of information will 
probably be more objective-oriented. 

The production of a message commences wi'.h an idea 
occurring to someone or with the need to convey information to a 
given target group. When an outline is ready, the generation of 
text, draft sketches, editing, graphical design, the production of 
originals, masters and, ultimately, a given quantity then begin. 
The sender produces a representation of reality. A representation 
is a medium with specific contents, i.e. a message. Other tasks 
for the sender are stock-keeping, distribution, marketing, ad- 
vertising, selling, billing, bookkeeping etc. 

From writers to readers 

Cave paintings, rock inscriptions, clay tablets, rune stones, 
church paintings, ietteis and other hand- written material are all 
examples of unique documents conveying a direct message from 
the sender/write., picture creator to the receiver/reader. Although 



46 



46 



these messages were sometimes intended fo^ gods and other 
higher powers, not for people. 

Text and pictures have been produced, distributed, stored and 
utilized for thousands of years. The first "travel guides" where 
produced and sold as early as 2000 B.C. They were the Egyptian 
"Books of the Dead" which contained advice and information - in 
an integrated, lexivisual amalgam of text and pictures - on coping 
with the trip to the Kingdom of Death. They where completely 
hand-made rolls of papyrus and, thanks to their high price, only 
available to truly wealthy families. The trade in these books is 
reminiscent of the medieval Catholic Church's trade in letters of 
indulgence. Both phenomena are examples of what could be 
called profitable publishing. Duplicates were made in the most 
literal fashion imaginable by "middlemen", specially trained 
scribes and copiers who copied text and drawings, often 
repeatedly. The industrial production of books a comparatively 
modem phenomenon. Despite the fact that Looks began to be 
printed more than 500 years ago, printing remained an exclusive 
and painstaking handicraft foi many years. Gutenberg's 42-line 
bible was printed on 316 pages and took 3 years to make (1452 - 
1455) in an edition comprising 200 copies. 170 of these copies 
were printed on paper and 30 on parchment. 5,000 calf skins 
were required for the parchment versions. One goatskin was 
needed to cover each book. 

Even at an early date, libraries of different kinds acquired 
major importance as "institutional middlemen" in the transmission 
of information rrom writers to readers. The first public library, 
Pisistratus, was founded more than 2,500 years ago (540 A.D.) 
in Athens. The first bookstore was opened, also in Athens, 160 
years later (400 A.D.) Until the middle of the 19th century, 
bookstores often served as publishers too, producing as well as 
selling books and other graphic products. 

A great many people in different occupational categories are 
required for transmitting a message from writers to readers. 
People such as text and picture editors, graphic designers, 
typesetters, repro technicians, printers, booKbinders, stockroom 
staff, salespersons, order takers, bookstore employees, 
librarians, buyers and administrators. The different steps involved 
in publishing are time-consuming and jointly represent a major 
expense. About ten percent of the price of a book, not including 
tax, usually goes to the author. 

Electronic publishing could change this situation to some 
extent. It \/ould reduce the distance between writers and readers 
even further. New opportunities for a dialogue could then develop 
in some instances. 
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Consequences of electronic publishing 
There are a number of approaches to the field of electronic 
publishing. Depending on their frames of references, different 
people can interpret the same phenomenon in different ways. 




Different people see the same phenomenon in different ways 



The user 

The user/reader wants a fast, cheap, easy-to-use system. 
Disseminated information .nust also be presented in a clear and 
legible manner. A great deal of research and development is 
needed in this area. Poor legibility is currently fairly common in 
e.g. videotex, thanks to the erroneous use of colors, for example. 

The volume of available information is constantly expanding. 
This may make it even harder for people to find desired 
information. 



The expert 

The information supplier/writer is offered new opportunities for 
presenting her/his message. In the future. Tactual information, 
training and entertainment will be processed in digital form 
throughout the entire production chain. 

Writers and experts in different fields can generate their own 
texts and numerical tabulations in computers using programs for 
word processing, spreadsheets and graphics. Artists can create 
their illustrations with computer-aided image processing systems. 
Photographers can use a video camera for recording video 
frames, stored as individual pixels, on magnetic discs. 
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The publisher 

The producer/publisher can "polish" basic material with 
typographical measures, editing and information verification. The 
results of her/his efforts can then be stored (sometimes in 
versions especially tailored to different user categories) for 
convenient user access. Like a database operator and supplier of 
hardware and software, the producer must market her/his services 
and find a sufficient number of buyers for those services. 
Increasingly flexible systems are making it easier to reach groups 
with special interests in different parts of the world. The 
development of new technology and new media present 
producers with exciting new options. An optically readable plastic 
card (about 3x2 inches) with 2 magabytes of onboard memory 
can store 800 pages of text, 2 hours of music or 200 computer 
graphics frames. Once they get into large-scale production, the 
cards should only cost about $1.50 each. Optical compact discs 
offer interesting prospects for the storage of large volumes of 
information. In November 1985, the American publishing 
company Grolier issued all 20 volumes of tlie Academic American 
Encyclopedia, containing 9 million words, on a single compact 
disc (CD-ROM). A computer, a CD- ROM-drive and suitable 
software make it possible for disc buyers to browse at will in this 
vast database. 

Traditionally publishers and book-sellers have been working 
with books. Books are products. We can hold them in our hands. 
We can use them when we like and as often as we like. 
Regardless of the content, fiction or non-fiction the book is still a 
product. Only a small part, say 10%, of what you have to pay for 
a book is the cost of the actual content. The rest is ta^es, 
marketing and production costs. In the future, products are 
gradually going to be replaced by "content-services", that is 
services to give people the information, the knowledge, the news 
or the entertainment they want to have in a specific situation. 
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The traditional function of the information producer has been to coordinate 
people with ideas, experts on subject matters, writers, artists, designers, 
photographers and others in the production of original, masters and run. 
Traditional tasks have also been stock-keeping, marketing, distribution, 
accounting etc. Reactions from the consumers gives the information producer 
knowledge for new or reversed editions, new runs and even now products. 
The information/content is delivered by means of the most suitable media. 
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In the future information society with deta'^ases, cables and terminals installed it 
will be very easy for anyone with knowledge of a subject matter to "publish** 
certain kinds of information such as tables, manuals, reference books, 
dictionaries etc. The consumers, the user^ of the system can easily access the 
information they need. 

When products gradually are replaced by "content-servic.cs" 
we will have a psychological type of problem. How much are 
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people really willing to pay for something they cannot hold in 
their hands and keep in a physical representation? There is some 
experience from rental of video cassettes for entertainment. There 
are not yet much experience from the fields of information oi 
education. 



Others 

On-line databases are offered by different kinds of customers, 
such as the printing companies, publishing houses, computer 
manufacturers and libraries. 

Libraries will gradually improve their range of service by 
offering new media. Phonograms and, to some extent, 
videograms and on-line database searches are already available. 

The OCLC (Online Computer Library Center) is an in- 
teresting development. For example, the OCLC has a database 
holding more than ten and one-half million literature references 
and information on 166 million physical books, newspapers and 
magazines at 7,000 libraries. The OCLC is developing full-text 
databases, based on e.g. the aforementioned CD-ROM technique 
v;ith facilities to permit local write-out of hard copy if, when and 
wherever needed. 

Network operators (Sweden has only one, the National 
Telecommunica-tions Administration) must invest vast sums on 
the expansion and mainte-nance of their digital networks. 

In future, networks will be capable of handling text, audio, 
video, pictures and data. 

The Government is commissioning an increasing number of 
studies to examine the need for control systems, ethical rules and 
new sources of tax revenue. Copyright of and responsibility for 
factual information, i.e. data in constant need of change, 
processing and updating by many different people, are among the 
most difficult issues being addressed. 



Changes in media consumption 

It is unlikely that we will wish or be able to spend as much time 

on the media in the future as in the past. Economic trends suggest 

that there is unlikely to be any scope for major cost rises, in 

addition to inflation, for the mass-media in the next few years. So 

new media will have to compete with the media already in 

existence. 

In the 80's people all over the world will be receiving far 
more audio-visual information than at any other time in history. 
And people working in audio- visual/video communications will 
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be striving to help people communicate, educate, train, and 
inform. 

The list of media in 1990 will still be longer than the list in 
1980. 

In my view, the media likely to decline in relative importance 
are letters, advertising throwaways, posters, certain books, 
newspapers, magazines, traditional AV media, radio and 
television. 

Media likely to increase in relative importance are various 
telecom services, phonograms, videograms, teletext, videotex, 
cable TV and satellite TV. 

For many years now the Nordsat project has been discussed 
and under study. Nordsat would allow total exchange of all 
national radio and television channels within the Nordic area. 
There has also been a discussion on a Swedish satellite, Tele-X, 
which is meant to be a purely industrial project which will be used 
for data and broadcast experiments. Regardkss of any nordic 
satellites there will be different European satellites reaching good 
parts of Sweden in the late 80's. 

Telefax are not likely to become widespread in the 1980's but 
might be commonplace toward the end of the 1980*s. 

Developments in the I980's and I990's will be fully realized 
in our information-oriented society around the year 2000. 

Letters, certain books, new^pafJers, magazines, traditional 
AV-media, radio and television will all decline considerably in 
importance. 

Media likely to predominate in the "information society" are 
telecom services, videotex, cable TV, satellite TV, teletext and 
various computer services. Most media will be under voice 
actuated or image-actuated control, making it unnecessary to have 
complicated routines to enter information via keyboards. 

TV, videograms, cable TV, satellite TV, radio and 
phonograms will be our most important sources of entertainment. 

Teletext, cable TV, TV and radio will be our most important 
sources of news. 

Books and videograms with computerized search systems 
will be our most important source of knowledge and education. 

Videotex, books and computerized reports, which are seldom 
printed in their entirety, will become our most important sources 
of information. 

To summarize, I predict the following long-range clianges: 

1 A transition from products to services. 

2 An increasing degree of segmentation. 

3 Increasing flexibility. 
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4 Increasing competition for the individual consumer s time and 
money, 

5 Gradual disappearance of demarcations between different 
media. 

6, Ctevelopment of new media and techniques through 
"hybridization". 

7 Replacement of the different systems currently available by one 
international, integrated digital telecommunications system. 

8 Development of a single world standard for TV. 

9 Increasing copyright problems. 



The introduction of new media 

Before introducing new media it might be a good idea to consider 
viewpoints from users, producers, originators and also from 
society. 



User's viewpoints 
Demand 

Is there a demand for the new medium? Where? Why? For which 
categories? 

For which purpose is the new medium intended? 
Do other media offer the same or corresponding services? 
Which are the unique advantages of this medium that other 
medium are lacking? 

How is the new medium adapted to reality? 
Use 

Is the medium easy enough to use? 

Does the user benefit in any way from using the new medium? 
How? Why? 

For how long will the medium serve its purpose? 

Will the media soon be "old-fashioned"? 

Is there a rapid technical development to be expected within the 

field that the medium represents? 

Costs 

Are the costs of the medium, when it is systematically used, 
higher than the costs of other media, which provide the 
corresponding information or experience? Is the cost a critical 
factor? 
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Demand 

Is there a demand for the new medium? Where? Why? For which 
categories 

For which purpose is the new medium intended? 
Do other media offex" the same or corresponding services? 
Which are the unique advantages of this medium that other media 
are lacking? 

Production 

Can production be carried out within the frame of the present 
organization? By employees? By consultants? By "traditional" 
authors, drawers, photographers and others? 
Must new personnel (competence) be recruited? Who? Why? 
Are special skills needed for production of originals? Which 
skills? Which time-schedule? Costs? 

Are special skills needed for production of masters? Which skills? 
Time-schedule? Costs? 

Are special skills needed for production of editions? Which skills? 
Time-schedule? Costs at different editions? Could the supply of 
raw material be a critical factor? 

Are there any problems as to updating?Why?Time-schedule? 
Costs? 

Stock 

Is storage possible within the frame of the present organization? 

Is there a problem as to "perishables"? 

Costs? 

Marketing 

Can marketing be effected within the frame of the present 
organization? 

Is there any demand for special competence? 

Are there existing markets? Where? Which? How big? 

Can the users be reached through advertising? In which 

publications? Cdsts? 

Is it necessary to have an organization for direct selling? 

Is there a requirement for a special hardware? 

Is the necessary hardware available? Quality? Costs? 

Should the media be sold by tlie piece like certain products? 

Can you sell a "package" of hardware/software? 

Can you sell subscriptions? 

Is a high degree of price sensitivity to be expected? 
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Are there "psychologically determined price levels" because of 
established price levels on similar services? 

Distribution 

Can distribution be carried out within the frame of the present 

organization? 

Costs? 

Debiting 

Can invoicing be made within the frame of the present 

organization? 

How do we charge? 

Costs? 

Administration 

Can the present organization be used for administration? 
Costs? 

Investment/Financing 

Does the new media claim special investments? 

By which means is the media financed? 

For how long will the media serve its purpose? 

Will the media soon be "old-fashioned"? 

Can you expect a rapid technical development within the field that 

the media represents? 

Copyright 

Is die product protected as to copyright? 

Can the products be protected from being copied? 

Are there any great risks with regard to copying? Why? To what 

extent? 

Statement of accounts 

Are fixed payments to different originators advisable? 
Is a royalty account system appropriate? 

Can statement of accounts be made out to the originators within 

the present organization and with the present routines? 

Costs? 

Profitability 

Which profitability can be achieved and when? 
Are there other alternatives with better profitability? 



Originators viewpoints 

Demand 

Is there a demand for the new medium? Where?Why? For which 
categories 

For which purpose is the new medium intended? 
Do other media offer the same or corresponding services? 
Which are the unique advantages of this medium that other media 
are lacking? 

Income 

What is the income? 
When is the money paid? 

Production 

Are there new creative possibilities? 

How will the working situation change? 

Do I actually need the producer? way? for what? 

Copyright 

Is the product protected as to copyright? 

Can the products be protected from being copied? 

Are there any great risks with regard to copying? Why? To what 

extent? 



Viewpoints of the society 
Value 

What is the value with the new medium? To whom is it "eood'"^ 
To whom is it '*bad"? Why? 

Is the new medium likely to inflict any laws or ethical roles'^ 
Which? To what extent? 

Tax 

Is it possible to introduce new taxes? When? How much will it 
give? 



Security 

Will the new medium influence national security? Why? How 
much? 
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Screen Communication 



Today computer-based interactive systems are increasingly used 
for training and learning in schools as well as in industry. 
Graphics are combined with text. Videotapes and videodiscs may 
give high quality pictures. Voice input and output are also used. 
However, images used in most new media, like teletext, videotex, 
personal computers, and CAD/CAM systems, are often far too 
difficult to read and understand. Often combinations of colors are 
made in such a way that the actual information is more os less 
lost. Knowledge of traditional print design is usually not utilized. 

Technical factors, programming factors, language factors and 
contextual factors all influence the viewer's ability of perception, 
learning and memory with respect to the function of the brain and 
the sensory organs. To achieve "good quality" man-machine 
interaction we have to consider all these factors in a kind of 
"wholeness-perspective". To learn we must be able to hear, see 
and also understand the message. 

In my view, it is no use to develop new, advanced systems 
and forget the aspects of the human factors. Such systems will 
never be successful in the long run. 




Man-machine interaction in a "wholeness-perspective". 

In a printed material, such as a book, the table of contents and 
the index makes it easier to find information according to one's 
wishes. When a person has read a page in a book, he or she may 
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easily proceed to additional information by turning the page. 
Information stored in a computer system may be accessed in 
several different ways. The ease of use and the man-machine 
interaction is of vital importance. It is necessary to make the 
system as user friendly as possible by providing user support 
systems, standard function keys and for example a possibility of 
full text search. Instructions should always be clear, consistent, 
concise, and simple. It seem to be very important that the user has 
full control of the system, i.e. with respect to reading rate when 
text is presented. 

Compared with traditional graphic presentations, a 
presentation of information on visual displays is very limited. 
Still, information may be presented in many different ways. 
Obviously the use of color is important. Different "rules of 
thumb" will apply to different types of presentation. Information, 
the "content", might be represented as text, as numeric data, or as 
visuals. 



Visual Displays 

Visual displays can be built in many v/ays. A color television set, 
an advanced color terminal, and a liquid crystal display all have 
very different characteristics. A television set is built to be 
watched at a distance of more than 120 centimetres. A computer 
terminal, however, is built to be used at a distance of 60 
centimetres and has a much better picture quality. It also cost a lot 
more. 

In discussions on technology, colors is related to measurable 
amounts of light. In 1931 an international body called the 
Commission International de TEclairage (International 
Commission on Illumination), or CIE, defined standards of light 
and color. In this context color primaries are the basic color 
stimuli used for the synthesis of any color, by addition or 
subtraction. For color synthesis in a cathod ray tube (CRT) or a 
visual display unit (VDU), a range of colors can be produced by 
the additive combinations of a very limited amount of radiation. A 
color CRT is a vacuum tube, enclosing one or three electron guns 
for generating beams of electrons , a system for focusing the 
beam to produce a spot of visible light at the point of impact on 
the phosphorus screen, and for electric field deflection of the 
beam, suitable deflection electrodes. The thousands of small 
phosphorus dots are grouped into threes - called triads - with one 
dot emittin", radiation that appears red, one dot emitting radiation 
appearing u be green, and the third emitting radiation appearing 
to be blue. Red, green, and blue are called the "three primaries", 
RGB. One lumen of white is given by 0,30 red + 0,59 green + 



58 



53 



0,11 blue. Any two primary colors may be mixed to produce 
other colors. Red and green added can produce a range of hues 
around yellow. Green and blue produces a range cantered on 
blue-green, while red and blue mixtures produce a red-blue range. 
The total number of colors that can be produced in a CRT 
depends upon the number of steps or grey levels obtainable for 
each phosphorus dot. Advanced systems are capable of producing 
up to 256 simultaneously visible color stimuli chosen from a 
palette of 16 million. However in most cases only a few color 
stimuli are needed at the same time. 

The uncertainties in the co-ordinates of colors are rather large 
as a consequenc< of the heterogeneous distribution and efficiency 
of the phosphorus over the screen, the defects in elctron beam 
convergence, and the departures of the relations between the 
values of the color signals and the digital counts. 
One consequence of additive combinations in color television is 
that characters presented in white (the three-color-combination) is 
less sharp than yellow, blue-green, or red-blue (all two-color 
combinations). In a similar way the latter colors are less ''harp 
than red, green, and blue (pure colors). Sometimes color rims 
may be seen at the characters with two- or three-color com- 
binations. 

Standards for Visual Display Units 



Sweden 

SIS Draft 1982 



U.S. 

US MIL Sid 1472B 



Polarity 



Positive image 



Positive or negative 
for high ambients, 
negative for low 



Refresh race 



Flicker-free, 
no after images 



Resolution 



10 raster lines 



Font design 



Dot matrix 



Character format 



14x11 (capitals) 



5x7 dot matrix (min) 
7x9 preferred) 



Stroke width 



12-17 % of charrcter 1/6 - 1/8 character 
height ' for positive images 



Viewing distance 



600 mm ±100 mm 



400 mm (min) 



Character height 



4 mm (min) 20' of arc 18' of arc (min) 
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Character width 
Distance between lines 
Distance between ch 
Distance between words 
Background luminance 
Character contrast 

Blink rate 
Color contrast 



50-70% of ch height 

170%ofch height 

20-30% of ch height 

50-70% of ch height 

170 cd/m^ adjustable 

1:8-1:12 (preO. 
l:20max 



One halfch height 
One stroke width (min) 
Width of one ch (min) 



0.75(4:1) 
(Lh-Lh)/L h 

3-5 Hz 

Color symbols on back- 
ground of different color, 
equal luminance shall not 
be used 



ch=charactcr 

The additive combination starts in dark adding light to 
produce color. Thus, v*nother consequence of additive 
combinations is that secondary color stimuli will always appear 
brighter than the primaries. 

Luminance is a photometric measure of the amount of light 
emitted by a surface (lumen/steradian/sq.m.). Radiance is a 
radiometric measure of light emitted by a surface 
(watt/steradian/sq.m.). It should be noted that neither luminance 
nor radiance is the equivalent of brightness, which is the 
experienced intensity of light (bright-dull). In color displays it is 
wt.y difficult to distinguish brightness from l;ghtness (white- 
black). When the signal to the display is increased, the brightness 
of the total screen is increased. If a signal to a specific part on the 
screen is increase 1, the lightness of the area is increased 
compared to the total screen. 

It is usually possible in a CRT to adjust the luminance, the 
hue, and the saturation. Like brightness and lightness, hue and 
saturation are also psychological dimensions. Hue is the basic 
component of color corresponding to different wavelengths. 
Saturation is most closely related to the number of wavelengths 
contributing to a color j-ensatioii. We should always remember 
that the pioduction of color, by additive or subtractive methods, 
have nothing to do with the actual perception of colors. 
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In different countries standards for visual display units, with 
several detailed statements, have been agreed upon. For example 
standards for Sweden and the U.S.are as follows: 

In a CRT some 8,000 to 20,000 volts of tension are required 
to form an image on the screen. Screens with several colors even 
requires up to 30,000 volts. The electrostatic field of the CRT is 
positively charged. Thus the person sitting in front of the screen 
is negatively charged and a strong field is created. The field 
affects the movement of dust particles in the air. Since the 
majority of the particles are positively charged they are attracted to 
the operator. Th^ rate of deposit can reach 10,000 particles per 
square millimeter of skin an hour. Thus skin and eyes become 
irritated. People suffering from allergies can experience extreme 
discomfort. The electrostatic field can be eliminated with the help 
of a grounded niter, mounted on the screen. 

The elctromagnetic field is created by the large magnets used 
to focus and direct the electron beam on the screen. The 
electromagnetic radiation consist of two components of which one 
can be shielded. 

It is not clear as to whether this radiation affects the adult 
human body unfavorably. 

However it is known that this radiation might be injurious to 
unborn children when pregnant women work to many hours in 
front of the screen. 



Color Description Systems 

The relationship between hue, lightness, saturation, and 
brightness are very complicated. For practical use in art and in 
industry, several different systems providing numerical indexes 
for color have been developed. The most important ones will be 
mentioned here. 

The Mmsell System was introduced in 1905 and has been 
modified several times. The system consist of fixed arrays of 
samples which vary in hue, lightness (here called value) and 
saturation (here called chroma). The value scale ranges from 
white to black with nine steps of grey. Hue is represented by 
forty equal steps in a circle. The value and the hue is related to 
each other by a maximum of sixteen "saturation steps". The 
Munsell notati iis are defined by the color sample of the'Munsell 
Book of Colors 

There are many theories about how perception of colors 
actually works. In 1807, Young proposed a trichromatic color 
vision system. In 1924, Young's theory was formalized by von 
Helmholtz, who proposed hypothetical excitation curves for three 
kinds of cones in the retina, sensitive for red, green, and blue. In 
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1925 Hering based ais "natural system" on man's natural 
perception of color that presupposes two pairs of chromatic colors 
block each other, red/green and blue/;, ellow. This model is the 
principle for the Natural Color System (NCS), developed during 
the 1970s in the Swedish Color Centre Foundation in Stockholm 
(HSrd /?c Sivik, 1981). From a perceptual point of view, man 
perceives six colors as "pure". Black and white are achromatic 
colors. Yellow, red, blue, and green are chromatic colors. 

These six colors are called elementary colors. All colors that 
are not pure elementary colors have a varying degree of 
resemblance to several elementary colors. Thus every possible 
color can be described with a specific location in a three- 
dimensional model, a twin cone, called the "NCS Color Solid". 
The chromatic elementary colors yellow, red, blue, and green are 
all located on the circumference of the Color Circle. Each quad- 
rant can be divided by one hundred steps, thus describing the hue 
of a color. The color Triangle is any vertical sector through half of 
the NCS Color Solid. It is used to describe the nuance of a color, 
i.e., its degree of resemblance to white, black, and the pure 
chromatic color of the hue concerned (chromaticness). 

When we want to describe a color using the color triangle and 
the color circle, it is done in the following sequence: blackness, 
chromaticness, and hue. For example, a color of 10 percent 
blackness, 80 percent chromaticness and with a hue of Y70R will 
have the notation 1080-y7OR. 

The NCS places emphasis on qualitative variation in the color 
sensation whereas the Munsell System is based on equally spaced 
visual scales. Both systems are based on surface colors. 



white 




black 



The NCS Color Solid 



62 



maximum 
sensitivity 
in the eye 




increasing sensitivity 



minimum 
sensitivity 
in the eye 



focused 
behind 
fovea 



focusad before fovea 



The NCS Color Circle combined with information on the eye's sensitivity. 

In the hue-lightness-saturation system (HLS) the hues are 
arranged as circles on the outside of a double cone resembling the 
NCS Color Solid (Murch, 1983). Hue specifications starts with 
blue at 0 ^ and then follows the spectral order around ihe circle. 
Lightness and saturation are defined as percentages from 0 to 
100. The HLS system is easy to use for colors on the surface of 
the model. However , colors inside the model are difficult to 
define. As in the Munsell- and NCS-systems, brightness creates 
problems. 

The hue-value-saturation system (HVS) is a model that is 
rather similar to the NCS-systeni but utilizes another coding 
(Samit, 1983) Value is defined as the relative lightness. White has 
full value and black has no value at all. Also brightness creates 
problems. 

In visual displays the color stimuli are specified by red, 
green, blue (RGB) values as discussed above. People who are 
specially trained can use the RGB proportions as a color 
description system. However, this is not possible for people in 
general. 



The message on the screen 

The message on the screen may consist of text, numeric data 
and visuals. 
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Text 

A presentation of text on a visual display depends on the type of 
characters used, the design of the information, the background, 
and also the content. 

The characters may vary with respect to font, size, lower-case 
and uppercase letters, color, and contrast to the background. 
Legibility of the text depends on the execution of the individual 
character and the possibility for each one lo be distinguished from 
all others. A lot of work has been conducted to create legible 
characters. Knave (1983) has given guide-lines for the creation of 
characters. A xninimum of ten to twelve raster lines per character 
is required. When characters are built by dots in a dot matrix, the 
characters will be round or square and not elongated. A dot matrix 
of seven by nine dots is often regarded as a minimum. The height 
of the characters should be a minimum of four millimetres for a 
viewing distance of sixty centimetres. 

General design rules should be employed also in the design 
of screen displays. Thus material should be arranged and 
displayed so that it is easy to read, from top to bottom and from 
left to right. 

A visual display design may vary with respect to spatial 
organization like headings, length of lines, justification, spacing, 
number of columns, number of colors at the same "page", and 
directive cues like color coding, twinkling characters or words, 
and scrolling text. Experiments (Pettersson et.al., 1984a) with 
11,000 individual judgements of perceived reading efforts of text 
on visual displays were concluded as follows: 

- Colors presented on color displays seem to be ranked in the 
same order as surface colors in traditional print media. Blue 
was most popular. 

- When text is shown on a visual display, there is no easily read 
color combination. About thirty-five of one hundred and thirty- 
two combinations ai*e acceptable. Most color combinations are 
bad. 

- The best text color is black, which causes good contrast to 
most background colors. 

- The best combination is black text on a white or yellow 
background. 

- A text can be easy to read in any color, provided the 
background is carefully selected. 

- The best background color is black, which has good contrast 
to most text colors. 

- Reading efforts of color combinations are independent of the 
sex of the subjects. 

' There was no difference between color blind (red-green) users 
and users with normal vision. 
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Inverse writing in various colors within a text may be used to 
achieve emphasis. Other possibilities may be a box around a 
paragraph or a change in font or size of letters. 

Blank space in printed material increases cost, since more 
paper is required. Thus, it is not used often. However, color as 
well as blank space on a visual display is essentially free and 
might be used to increase readability. Full text screens in several 
colors are difficult to read and quite annoying. What about double 
spaced lines and/or spaces between columns? As stated above it is 
possible to make rather clear statements with respect to the use of 
colors . However, it is not as easy to give guide-lines for the 
other variables. Studies of attitudes to various variables 
(Pettersson et.al., 1984b) in the presentation of text on visual 
displays showed that subjects dislike fast scrolling text. Subjects 
seem to dislike more than three or four text colors on the same 
"page". They seem to consider color coding and/or twinkling text 
to be a good way to show that something is especially important. 
Subjects also seem to agree that text in upper case letters is harder 
to read than normal text. Attitudes are indifferent to a few design 
variables. Thus text on every second line only does not seem to 
make it easier to read than text on all lines. Higher characters do 
not seem to be easier to read than standard characters. Half lin^^ 
do not seem to be better than full lines. A two-column layout does 
not seem to be better than a one-column layout. Other research 
suggest that margins should neither be narrow nor very wide. Old 
text that is not needed any more should be erased. 

The background may vary with respect to color and 
brightness. Good combinations of text and background colors 
always have a good contrast. Optimum contrast is often found to 
be 8: 1 to lOrl.Most subjects prefer a positive image i.e., dark text 
on light background with a minimum refresh rate of 70 Hz. 

CLEA-research (Pettersson, 1984a) concerned with per- 
ceived reading efforts of text on visual displays and altering 
colors of the actual equipment found that the close context is 
really important for the perceived reading effort. The color of a 
terminal should be rather discrete. The best of ninety 
combinations were black text on a white screen with a dark grey 
terminal, closely followed by the context colors black, white, and 
light grey. It was also found that it is an advantage when the 
context color is the same as the color of either the color of the text 
or the background on the screen. The combination of context and 
text/background colors must match against each other. If they 
clash the reading effort increases. 
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Further experiments (op. cit.) with altering ambient light 
levels showed that this is of no or very limited importance for the 
perceived reading effort. 



Numeric Data 

Computer graphics hardware and software have become widely 
available. In advertisements it is often stated that business 
graphics communicate the information effectively, thus being very 
useful. However, in real life situations graphics often tend to be 
very poorly designed. Thus they may fail to improve the 
communication. Sometimes bad design might even make 
communication difficult or even impossible. Bertin (1967), 
Cossette (1981), McCleary (1983) and Pettersson (1983) all 
discuss the importance of individual design variables in visual 
language. However, these discussions are all based on research 
on traditional print media. Ehlers (1984) points out problems of 
legibility in business graphics. According to him direction and 
pattern or texture of graphic elements appear to be important 
factors as well as color and size. 

In the CLEA-laboratory studie: of attitudes to different 
variables in the presentation of infcnnaiion on visual displays 
(Pettersson et al., 1984b) showed that subjects consider it easy to 
see the difference between vertical bars as well as between 
horizontal bars. 

Further experiments by Fahlander & Zwierzak (1985) have 
shown that the greater the difference is between the color in a 
graphic presentation the more distinct is our perception of the 
border between the color spaces. On white background the 
following color combinations are suitable to use: Black combined 
with yellow, yellow-red, red, blue, green or the mixtures of red- 
blue (magenta), blue-green (cyan) and green-yellow. Onblack 
background the following color combinations are suitable to use; 
White combined with yellow-red, red, blue or the mixtures of 
red-blue. On white as well as on black background the following 
combinations are suitable to use: Yellow combined with red and 
blue, red combined with blue-green or green-yellow, red-blue 
combined with green or green-yellow. 

Following this study Azoulay & Janson (1985) found that 
some colors used in business graphics have much higher aesthetic 
values than others. Blue, red and green are liked the most. 

In an effort to find some more detailed knowledge about our 
perception of business graphics two comprehensive experiments 
were carried out with respect to relationships between variables 
and parts of a whole (Pettersson and Carlsson, 1985). 
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The findings, based on more than 2,300 individual as- 
sessments were concluded in the following points: 

- Graphical information is very good in conveying a survey of a 
situation. 

- When relationships between variables shall be presented, 
comparisons of lengths give the best results. 

- When parts of a whole shall be presented, comparisons of 
areas can be used as welL 

- Design of graphic elements is important to consider. Most 
available patterns are probably less good. Patterns should be 
discrete and not disturbing. 

- Colors like blue, red and green are liked very much but they do 
not improve our possibility of reading the message accurately. 

- Different parts in graphic figures should have about the same 
luminance and radiance. The true differences between areas 
can be hard to see when shaded differently. 

- When accuracy is needed graphical information should be 
combined with actual figures. 

In "Choosing The Right Chart" ISSCO (1981) supplies 21 
practical guide-lines, pointers on effective chart design such as: 
"Make bars and columns wider than the space between them." In 
a study Ek & Frederiksen (1986) used the CLEA-equipment to 
find out about effective chart design. 40 subjects assessed the 
difference in size between two bars in a bar chart with six bars. 
The bars had one of three possible widths (1/60, 1/30 and 1/15 of 
the screen width.) The distance between the bars had one of six 
possible values, from zero to more than twice the bar width. The 
bar charts were produced and displayed at random and always 
presented with blue bars on black background. The findings, 
based on 3,600 individual assessments showed: 

- The bar width has no influence on our perception of size. 

- The space between bars has no influence on our perception of 
size. 

This study confirmed earlier findings (with the perception of 
vertical lines.) It can be concluded that we can make screen design 
according to aesthetic appeal. 

Finally, it may be stated that ir is extremely easy to convey 
misleading information about statistical relationships by using 
misleading illustrations. Those who are serious in their work 
should avoid these mistakes. 
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Visuals 

Our perception of visuals on visual displrys are of course to a 
large degree dependent on the quality of ihe screen, especially 
when pie charts are used. European videotex terminals simply can 
not reproduce a pie chart since the graphics resolution is only 
about 5,000 graphical elements. An ordinary television image 
consists today of about 250,000 image points or picture elements 
which vary with respect both to grey scale and color information, 
Hayashi (1981) has reported on the development of High 
Definition Television (HDTV) in Japan. HDTV uses l.ll^ 
scanning lines and can contain five or six times more information 
than the present NTSC standard color television system with 525 
lines. HDTV developments of flat plasma screens will also give 
increased technical possibilities for better perception of the visual 
information. 



Computer Print-Outs 

In visual displays, the color image is produced by an additive 
mixture of red, green, and blue. However, in the production of 
hardrcopies, computer print-outs as well as in painting, printing 
and also color photography a subtractive method of combining 
inks, dyes and pigments is used. Most colors can be generated in 
printing with the use of yellow, cyan (blue-green) and magenta 
(red-blue). Together these primaries produce black. However, 
pure black is often included as a fourth printing color because the 
three primaries that produce the best chromatic colors usually do 
not produce the best black. Subtractive systems begin with a 
white surface. Colors darken as more wave-lengths are absorbed. 
(However, in some color hard copy printing, both additive and 
subtractive color combinations can occur,) The difference in the 
production of colors creates some problems. It should also be 
remembered that color codings will lose their meaning when 
monochrome printers, as well as displays, are used. 

There are many hard copy systems and possibilities to make 
computer print-outs for text as well as for pictures. 

Photograpfis 

The simplest way to make a hard copy documentation of a color 
display is to use a camera. Systems are available with hoods. 
Polaroid cameras give immediate results. In sophisticated systems 
analogue RGB signals from a color terminal are digitized and 
exposed to film. 
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Pen plotters 

Pen plotter are the simplest of the non-photographic methods. 
They are best suited to simple line diagrams. In some systems the 
pen/s are fixed and the papers are moved. Usually, the print 
quality corresponds to a matrix printer with 2-4 dots per 
millimetre. 

Color ribbons 

Wire matrix printers can use color ribbons. The matrix head 
traverses the paper, printing a single color at the time. The quality 
is usually about 2 - 4 dots per millimetre but may be enhanced by 
the use of more print-heads. Matrix and daisy wheel printers are 
very good for text. 

Ink jet printing 

Small dots of ink are sprayed on to the paper through a number of 
nozzles. The resolution ic determined by the ink drop size and the 
way it spreads on the paper. The quality range up to 20 dots per 
millimetre. It is possible to produce large size and high quality 
pictures. 

Type-setting machine 

Some computers may be linked up with professional type-setting 
machines. These *'print-outs" obviously can have a superb quality 
and be used for originals in the printing process. 

Electrophotography 

With three toners being applied in the same way as in laser 
printers, color prints can be produced. The quality is 4 dots per 
millimetre. However, the dots fuse together. Thus, the quality 
appears to be better than it actually is. 

Others 

Also other methods exist such as thermal transfer, wire matrix 
printers using ink instead of ribbons and electrostatic methods. 

In a study (Pettersson et. al., 1984c) print-outs from line, 
matrix, and daisy wheel printers were used. These eight samples 
were numbered and showed at random to 40 subjects who judged 
their perceived reading efforts of the different texts. The results 
showed that: 

- Only the two daisy wheel print-outs and a normal font, normal 
mode matrix print-out cause little reading effort and thus are 
easy to read and quite acceptable. 

- Reading efforts of print-outs are independent of the sex of the 
subjects 
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It may be concluded from this study and the previous 
findings (Pettersson et. al., 1984a) that a text presented in a good 
color combination on a visual display is easier to read than print- 
outs from several printers used today. 



70 

ERIC 7Q 



References 

Azoulay, B & Janson, H, 1985: Estetiska upplevelser avfdrgerpd bildskdrm. 
Undergra 'aaie thesis, Departmeni of Computer Science, University of 
Stockhc.t. 

Berlin, J, 1967: Semiologic graphique: Les Diagrammes, Les reseaux, Les 
cartes, Moutin, Paris. 

Cossette, C, 1982: How Pictures Speak: A brief introduction to iconics. 
Paper presented at the 32nd International Communication Association 
Conference, Boston, May 1-5. Translated from French by Vincent Ross, 
Quebec. 

Ehlers, J H, 1984: Problems in Legibility in Presentation Graphics . 
CAMP/84, Computer Graphics Applications For Management and 
Productivity, Berlin Sept 25-28. Proceedings: AMK Berlin, p. 34-41. 

Ek, G. & Frederikscn, M. 1986: Utformning av histogram. Undergraduate 
thesis. Department of Computer Science, University of Stockholm. 

Fahlander, P & Zwierzak, A, 1985: Grdnstydlighet mellan fdrger. 
Undergraduate thesis. Department of Computer Science, University of 
Stockholm. 

Hayashi, K, 1983: Research and Development on High Definition Television. 
SMPTE Journal, 1981, 3:178-186. 

Kelmholz, H C F, 1924: Physiological Optics, Vol II, trans. J Southall 
Rochester, N Y: Optical Society of America. 

Hering A, 1925. Grundzuge derlehre vom Lichtsinn, Handbuch der gesamtep 
Augenheilkunde, 2nd edition, 3rd volume, Beriin, 1925. 

HSrd, A & Sivik, L, 1981: NCS - Natural Color System: A Swedish standard 
for Color-Notation, Color research and application. Vol. 6, No. 3, p. 129 - 
138. 

ISSCO, 1981: Choosing The Right Chart. A Comprehensive Guide for 
Computer Graphics Users. San Diego 1981. 

Knave, B, 1983: The Visual Display Unit. In Ergonomic Principles in Office 
Automation. Uddevalla: Ericsson Information Systems AB, 1984. 

Laswell, H. 1948: The Structure and Function of Communication in. 
Society, in Bryson, L (red) the Communication of Ideas, New York: Harper 
& Brothers 

Lax, L & Olson, M, 1983: NAPLPS Standard Graphics and the 
Microcomputer. Byte Vol. 8, No. 7 July 1983, p. 82 - 92. 



ERLC 



71 



71 



McCleary. G.F.. 1983: An Effective Graphic "Vocabulary". IEEE Computer 
Graphics and ApplicaUons, Vol. 3. No. 2, March/April, pp. 46-53. 

McLuhan. M. 1967: Media. Manniskans utbyggnader. Stockholm: 
Pan/Norstedts 

MUitary Standard 1472 B1974 (US MIL STD 1472 B): Human Engineering 
Design Criteria for Military Systems, Equipment and Facilities. US 
Government Printing Office. Washington DC. 

Murch, G M, July 1983: Perceptual Considerati s of color. Computer 
Graphics World, Vol. 6, No. 7, p. 32 - 40. 

Parker, E.B. 1975; Social implications of computer I telecommunications 
^sterns. Program m information technology and telecommunications, Report 
No 16, Center for interdisciplinary research, Stanford University 

Pettersson, R. 1981: Bilder Barn och Massmedia. Stockholm- 
Akademilitteratur 



Pettersson, R, 1983: Visuals for instruction. CLEA-report No. 12, Dep of 
Info. Processing and Computer Science, University of Stockholm. 

Pettersson, R, 1984a: Visual Displays and Reading Effort. CLEA-report No. 
20, Dep. of Info. Processing and Computer Science, University of Stockholm 

Pettersson, R, 1984b: Numeric Data, presentation in different formats The 
16th Annual Conference of the International Visual Literacy Association 
Baltimore, Nov. 8-11. 

Pettersson, R & Carlsson, J, 1985: Numeric data on visual displays. CLEA- 
report No. 30, Dep. of Info. Processing and Computer Science, University of 
Stockholm. 



Pettersson, R., Carlsson, J., Isacsson, A., Kollerbaur, A., and Randerz, K. 
1984a: Color Information Displays and Reading Efforts. CLEA-report No. 
18. Dep. of Info. Processing and Computer Science, University of 
Stockholm. 



Pettersson, R, Carlsson, J, Isacsson, A, Kollerbaur, A, & Randerz, K, 
1984b: Attitudes to variables on visual displays. CLEA-report, No. 24, Dep! 
of Info. Processing and Computer Science, University of Stockholm. 

Pettersson, R., Carlsson, J., Isacsson, A., Kollerbaur, A., and Randerz, K. 
1984c: Reading Efforts on Prints-Outs. CLEA-report, No. 21, Dep. of Info. 
Processhig Computer Science, University of Stockholm. 

Samit, M L, 1983: The Color Interface, Making the Most of Color 
Computer Graphics World, No. 7, p. 42 - 50. 



72 

ERIC 



72 



Schramm, W. 1954: Procedures and Effects of Mass Communication, in 
Nelson. B.H. (Ed.). Mass Media and Education. The Fifty-Third Year-book of 
the National Society for the Study of Education, Part II, Chicago, University 
of Chicago Press, 1954 

Shannon, C.E. & Weaver, W. 1949: The Mathematical Theory of 
Communication. Champaign, II: Tlie University of Illinois Press 

SIS Swedish Draft Standard, 1982: Ergonomics - Requirements in visual 
information processing - Image quality on cathode ray tube (CRT) based 
visual display units for text presentation in office environments. Work Group 
for image quality norms for visual display units, HK 32-7K6-AG1. Image 
quality- 



id 

ERLC 



73 



73 



PerceptioUy learning and 

memory 



Contents 

Our senses 77 

Hearing 77 

Vision 78 

Eye movements 79 

Movement and change 84 

Listening and looking 85 

Perception "laws 85 

Ciioict of infomiation 88 

The brain 91 

Picture perception 94 

Assignments 94 

Approaches to picture perception 103 

Message design 105 

A cognitive moc^l 1 06 

Learning and memory 111 

Learning 111 

Memory 114 

Inner images 118 

Development 120 

Illusions 124 

References 128 



75 



Our senses 



How do we receive information about the outside world? We can 
smell, taste, feel, listen, Scc and examine our surroundings. We 
can also ask questions. We ultimately learn to interpret and "read" 
different coded messages, such as those contained in e.g. text. 



Some examples of the way we "receive" different kinds of messages. 

Smell, taste and feeling are not as yet especially important 
factors to be considered in information production. So only aural 
and visual impressions will be the subject of a brief discussion 
here. 



Hearing 

Sound is a subjective sensation of hearing, i.e. the sensory cells 
in the inner ear's hearing apparatus are stimulated. In objective 
terms, sound consists of longitudinal wave motions capable of 
acting on our hearing apparatus and thereby eliciting sound 
sensations. Sound waves are picked up by the outer ear and 
conducted along the external auditory meatus to the eardrum. The 
eardrum consists of an elastic membrane which resonates at the 
same frequency as the impinging sound waves. These vibrations 
are transmitted by the three ossicles of the middle ear, i.e. the 
malleus, incus and stapes, to the oval window, a membrane in the 
coiled cochlea of the inner ear. Thus, when the eardrum bulges 
inward, the oval window also bulges inward. This movement is 
transmitted to the fluid in the cochlea. Movements in this fluid 
excite auditory cells which, in turn, transmit signals to the hearing 
centre of the cerebrum. Another soft membrane, the round 
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window, provides flexible closure of the other end of the cochlea. 
Thus, the round windows bulges outward when the oval window 
bulges inward and vice-versa. 

Man is normally capable of perceiving sound waves at 
frequencies from 16 to 20,000 Hz. Sound waves lower than 16 
Hz are referred to as infrasound, and frequencies higher than 
20,000 Hz are referred to as ultrasound. 

Sound intensity, i, e. the average rate of sound energy 
transmitted per unit of time and unit area which passes a plane 
perpendicular to the transmission direction, is an objective 
measure of sound intersity. It is usually measured in w/m^ (watts 
per squere meter). However, a psychologically based concept is 
necessary in order to designate the strength of sound waves 
striking our ears. The hearing range is the interval between the 
lowest sound inteni^ity we are capable of perceiving, i.e. the 
auditory threshold, and the highest level we are able to tolerate, 
i.e. the pain threshold. The range is very wide, so it is usually 
described as the logarithmic ratio N of two intensities, Ir and li, 
measured in decibels. N^^IO^^ log Ir/Ii. The auditory threshold 
and the pain threshold varies with the frequency. The auditory 
threshold for normal frequencies( 1,000 Hz) is at 0.01 w/m^. This 
value is used as a reference, 0 dB, when sound intensities are 
compared. Sound strength can also be measured in phons. A 
phon is a unit for measuring the apparent loudness of a sound. It 
is equal in number of a given sound to the intensity (in dB) of a 
sound having a frequency of 1,000 Hz when the two sounds are 
judged to be of equal intensity. A quiet whisper usually measure 
about ten phons whereas a compressed air hammer in action 
usually generates 1 10 phons. 



Vision 

In subjective terms vision is a complex process which elicits a 
sense of vision, i.e. awareness of the stimulation of the eye*s 
vision perception cells. In objective terms, light consists of 
electromagnetic waves (light "rays") capable of acting on our eyes 
and creating sensations of light and images. 

Human vision is sensitive within a wide wavelength range. 
Visible light ranges from wavelengths of 400 nm (0,00040 
millimetre), that is violet, to 770 nm, that is dark red. In between 
these extremes are blue, green, yellow and orange. Green-orange 
(about 555 nm) lies in the region of the eye*s greatest sensitivity. 
Sensitivity decreases markedly toward the red and violet ends of 
the spectrum. 
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Like sound waves light waves are propagated in straight lines 
from their source. They can also be reflected, refracted, bent and 
absorbed. The velocity of light in air is nearly 300,000 knVs. 
When light rays (usually parallel) from an object enter the eye, 
they are refracted in the cornea and lens and pass through the 
vitreous humur until they strike the retina. When the ambient light 
level is high, the light rays strike the macula lutea, the fovea, a 
small area of the retina which is rich in cones. Cones are the 
receptors which record colors. When the ambient light level is 
low, the receptors which record black and white are of greater 
importance to vision. The classical view is that each sensory 
organ picks up individual sensory impressions which are in- 
terpreted more or less individually. The retina's receptors are 
excited by light and respond by chemically converting a pigment, 
rhodopsin (visual purple). This conversion triggers impulses 
which are traiismitted along the optic nerve to the brain's visual 
cortex. Here, the impulses arc translated into a sensation of 
vision. The optic nerves cross on their way to the cortex. Infor- 
mation from each eye reaches both halves of the brain. 

When light rays from an object are bent in the cornea and 
lens, an upside-down image of that object is formed on the retina. 
Very small children view the world as being up-side-down. After 
a time, however, the brain somehow learns to process retinal 
images so that they are perceived to be light-side-up. 

Since we have two eyes, both pointing forward and with 
partially overlapping visual fields, we can easily assess the 
distance, both forward and laterally, between objects . It takes a 
certain amount of time for the eye to record light rays from an 
object, such as a painting. And it also takes time before we are 
capable of perceiving that objects as an image. The eye has 
inertia. This inertia enables us to perceive motion. When we look 
at a person who is walking or running, the eye records a series of 
stills which ultimately blend into one another and form a moving 
image. This inertia also enables us to see motion in the stills 
which comprise a movie film or a TV image. 

Nowadays, however, sensory organs are often described as 
sensory systems and the total energy flux striking them viewed as 
information about the surrounding world and about ourselves .The 
individual sensory organs receiving this inforaiation are not 
merely passive receptors but jointly constitute an active, ex- 
ploratory system in which all the senses intimately interact 
supplying us with an undergirded view of the world. So we are 
spared the task of having to consciously translate a myriad of 
individual sensory impressions into coherent perception. 

According to Gibson (1966) the eye does not really operate 
like a camera. We are never conscious of the '*stills" formed on 
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the retina. We only perceive the external world they represent. 
The eye and head shift their attention constantly from one point to 
another in our surroundings or in a picture. Thus, our vision is an 
active, exploratory process. We usually concentrate our attention 
to interesting events within a narrow segment of our total field of 
vision. 



Eye movements 

Bergstrom (1974) noted that visual information on our 
surroundings is conveyed to the eye, a very imperfect optical 
system. Eyes never remain still. They tremble at a frequency of 
about 30-90 Hz. This serves to shift information of individual 
cells. The eye alters its fixation point constantly. It also makes 
constant small jumps, i.e. saccadic movements. 

We constantly "scan" the things we look at. By using 
complex instrumentation (Loftus, 1979) that allows the researcher 
to record exactly where in a picture a person is looking at any 
given moment it is possible to study the way in which the gaze 
wanders over a picture, pauses and fixes on certain points 
(Buswell 1935; Webb et al. 1963; Zuzne & Michaels 1964; Cuba 
e: al. 1964; Berlyne 1966; Leckart 1966; Gould 1967 and 1973; 
Yarbus 1967; Markworth & Morandi 1967; Faw & Nunna'y 1967 
and 1968; Fleming 1969; Wolf 1970; Noton & Stark 1971 a and 
b; Loftus 1972; Hochberg & Brooks 1978; Baron 1980; Nesbit 
1981; Pettersson 1983a). The gaze never fixes on most parts of a 
picture. Only certain image elements capture our attention 

Yarbus (1967) found that fixation usually lasts for two to 
eight tenths of a second and that eye movements between eye 
fixations took from one to eight-hundredths of a second. So we 
normally view a picture by means of a large number of eye 
movements and eye fixations in rapid succession. The location of 
each fixation influences how a picture is interpreted and later 
remembered (Nelson & Loftus, 1980) 

The pattern of eye movements and fixations is entirely 
different when our objective is to search for something in a 
picture. The things we wish to see in a picture have a major 
impact on the location of eye fixations. Where we look and why 
we look there determines what we see. 

A number of scientists have found that pictures which are 
hard to interpret require more eye fixations than "ea^y" pictures 
(Webb et al. 1963; Zusne & Michaels 1964; Berlyne 1966; 
Leckart 1966; Faw & Nunnaly 1967 and 1968; Markworth & 
Morandi 1967; Hochberg & Brooks 1978). 

Wolf (1970) determined that "difficult" pictures require more 
fixations up to a certain point. When a picture was extremely 
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difficult, subjects tended to avoid looking at it or searching for a 
visual center. However neither Baron (1980) nor Nesbit (1981) 
found any correlation between picture type and the number of 
fixations. But the two latter scientists did employ a different 
method in their studies than the authors mentioned previously. 

Faw & Nunnaly (1967 and 1968) also found that new 
pictures required more fixations than pictures with which subjects 
were akeady familiar. Movement or change in a picture or event 
also attracts attention and therefore cause many fixations. 

Cuba et. al. (1964), Gould (1973) and Nesbit (1981) found a 
positive correlation between eye movements and intelligence. 
Highly intelligent subjects utilized more fixations than less 
intelligent subjects. Wofr (1970) discovered that highly intelligent 
subjects displayed great flexibility in their "scanning patterns'', 
irrespective of tiie stimuli, whereas subjects v/ith low intelligence 
tended to display a static scanning pattern which was the same for 
different stimuli. Nesbit (1981) found a positive correlation 
between learning and the number of fixations. 

Wolf (1970) suggested that eye movements can be employed 
as an index of visual learning. Eye movements supply 
information on where, how long and how often subjects look at 
different parts of a picture. 

Looking at pictures is a "natural" way of free exploring. However 
reading a text need to be very structured with several eye fixations 
on each line. The time for each fixation varies amongst 
individuals and different texts (Ekvall, 1977) with the average 
time for good readers between 1/4 to 1/6 of a second. It also takes 
from 1/25 to 1/30 of a second for the eye to move from one fix- 
ation to the next and sweep from the end of one line to the 
beginning of the next. In normal reading the text within foveal vi- 
sion comprise an area of seven to ten letter spaces. At normal 
reading the angle of convergence is about 2^. This means a 
reading speed of five to ten words per second or 300-600 words 
per minute. Lawson (1968) has established the physiological limit 
of reading as being a maximum of 720 words per minute. Ekwall 
(1977) calculated the maximum reading speed of the most 
efficient reader as being 864 words per minute under ideal 
conditions. 
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During experiments adult subjects looked at a drawing of two flying House 
Martins (1) as indicated in the above eight analyses of eye fixations and eye 
movements. Analyses 2 • 5 represent female subjects and 6 - 9 male subjects. 
In each case the first eye fixation is marked with an unfilied circle. Each fixation 
takes about 1/5 of a second. In this case subjects got the instruction, "Tell me 
what you see!" It takes only a few seconds for adult subjects to recognize "two 
birds". 
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A modol of the "stills* formed on the retina during different eye fixations. Eye 
fixations are rapid, usually four to six per second. We are never aware of the 
stills on the retina. 

The importance of eye movements can be summarized in the 
following five points: 

1 Only certain image elements attract our interest. 

2 The pattern for eye movements and fixations depends on what 
we wish to see or are told to see in a picture. 
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3 Informative parts cf a picture attract more fixations than less 
informative parts. 

4 Different kinds of pictures give rise to different kinds of 
fixations and intelligence and visual learning. 

5 There is a positive correlation between the number of fixations 
and intelligence and visual learning. 



Movement and change 

Movement or change in a picture or an event attract our attention 
and therefore cause many fixations. Hubel & Wiesel (1962) 
found that many sensory cells in vision responded only ver^ 
weakly to uniform light but very vigorously to changes in light 
intensity. This principle also applies to other sensory cells, i.e. 
the cells respond primarily to change. Sensory cells are also 
quickly exhausted. Acuity falls of rapidly outside of the fovea. 
However some information can be processed from peripheral vi- 
sion The gist of a picture can be understood after only a few 
fixations. 

Gibson (1966), Moray (1970) and many of their successors 
feel that movements detected in peripheral parts ^ our visual field 
automatically cause the eyeball to shift positioK vu permit fixation 
of these movements. So even visual cells far from macula lutea 
are a major asset. Edwards & Goolkasian (1974) summarized a 
large part of the work carried out to determine the extent and 
importance of our peripheral vision. Not unexpectedly, they 
found that impact increases as stimuli approach the macula lutea, 
as they become larger, when they increase in brightness and when 
they have a low level of complexity. 

It is possible for us to see the difference between several 
million color stimuli at simultaneous viewing. However, if not 
being seen simultaneously the number we can identify is much 
smaller, maybe 10,000 - 20,000. It has been assumed that our 
perception of colours is a two sided phenomenon. The 
discrimination capability represents our possibility to differentiate 
a figure from its background. It is strongly influenced by and 
dependent on contextual variables such as lighting conditions and 
other surrounding colors. The color identification capacity on the 
other hand makes us capable to interpret "the quality" of object we 
perceive. "Color constaiiCy" is a tendency to judge objects as the 
same despite changes in illumination. 
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Listening and looking 



Sensory organr jointly constitute a perceptual system which, in a 
natural environment, collects an enormous amount of superfluous 
information about this environment. In a natural environment, the 
sensory sysu^m normally supplies us with exhaustive, 
unambiguous intelligence about events occurring there. We are 
often unawa4e of the sensory channel(s) supplying us with in- 
formation. We are merely aware of the external events, events 
which appear to be absolutely real and unambiguous. But in 
unnatural artificial surroundings, the brain often "translates*' 
sensory stimuli in an attempt to relate them to its stored 
information about more familiar plates, e . ents and times. 

We are capable of successfully hearing and seeing things at 
the same time. We are also capable of simultaneously hearing 
different stimuli in either ear. However, we are incapable of 
simultaneously perceiving different stimuli aimed at the right and 
left eye respectively. However, a stimulus may easily be 
perceived in different ways at different times. 



Perception ^^laws^^ 

The concept "perception" is a collective designation for the 
processes in which an organism obtains information on the 
ou* ' ' 'vorld. We unconsciously make a constant effort to create 
sc mblance of order in the impulses. Points, lines, areas, 
cc*w.^, tones, noise, heat, cold, touch, pressure, sound etc. are 
integrated in such a way that they can be interp-eted as a 
meaningful whole. A number of psychologists vu these 
attempts to establish order as an innate faculty canied out in 
accordance with ceitain "laws". According; to the "similarity law", 
we tend to group impressions on the h'dzh ci their similarity. 
According to the "proximity law", we also group objects and 
events on the basis of their proximity to one another. According 
to the "continuity lav/", we perceive a slow and gradual change in 
a stimulus as a single stimulus. Events which have a natural 
reHtionship to one another also give the impression of being 
continuous. According to the "natural law", various stimuli form 
meaningful patterns. According to the "contrast law", we tend to 
array impressions which form natural opposites, thereby 
reinforcing one another, in groups. Usually there is a constancy 
of size, shape, color and contrast in the perception of known 
objects. This is regardless of distance, angle and illumination. 

New impre^^sions are dependent upon and interpreted against 
the background of our previous experienr . a A learning, our 
attitudes and interests, our needs and feelings and the prevailing 
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situation. We direct our attention to things which are large, have 
bright color, move, deviate from the surroundings or from 
familiar patterns, things which arouse feelings and needs and in 
which we happen to be interested at the moment. 

A torrent of information bombards us from the outside world. 
Each eye contains about 1 million afferent nerve fibers. Each ear 
has about 30,000. Thus, the eyes and ears are capable of 
receiving vast quantities of information. However, it is 
impossible (and undesirable) for us to be aware of everything 
happening around us. At any given moment, the eye may contain 
2,500,000 bits of information. Laboratory studies have shown 
that a subject is able to perceive 3-6 different, simple graphical 
symbols per second when the subject's concentration is devoted 
solely to this task. It is easier to perceive large and clear symbols 
than small, blurred symbols. 

■H SB BH CB 

The "proximity law". We see four pairs of cols instead of just eight individual 
dots. Perception is organiz&d. 
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The "proximity law". Here we tend to seo four narrow columns rather than three 
wide ones. Perception is organizsci. 



■ BBSBHBB 



■■■■■■ SBBBBffB 

The "proximity law". Here we tdnd to see dots as horizontal lines. Perception is 
organized. 
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■ saaB a aaa 

aaaaa aaaa 
aaaBBBBBB 

BBBBBBBBB 

The "proximity law". Here we tend to see dots as vertical Itnes.Perception is 
organized. 

©©•a^^ooooo 

The "similarity law". We tend to group elements that look alike. Here it is easy to 
see two sets ci dots Perception is organized. 



oooooooooo 
oooooooooo 

The "similarity law". All dots are equally spaced. Yet we tend to see horizontal 
lines of dots. Perception is organized. 



The "continuity law". We see this pattern as two lines crossing rather than as 
two angles joined together at their apexes. This is also referred to as "line of 
direction". Perception is selective. 



The "continuity law", 
straight line rather tha 



We tend to see a curved line being intersected by a 
: four individual c\reas. Perception is selective. 
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The "natural law" or closure. We see this pattern as one circle partially occlud<Ki 
by another. Even though there are many possibilities, this interpretation seems 
to be the natural one. Perception is influenced by exp^^ri^iions. 




The "natural law". We see these black spots as letters forming a word if we can 
read. Perception is influenced by experience. 

a 

b 

0 ^ 

The "contrast law". A line (a) seems to be long when it is compared with a 
shorter line (b) but short when it is compared with a longer line (c). Perception is 
relative. 




The "confrast law'. An aroa (a) seems to be large when it is compared with a 
smaller area (o), but small when it is comoared ^^ilh a larger area (c). Perception 
is relative. 



Choice of informaiion 

The average person speaks about 135 words per minute (Judson, 
1972) and the fastest professional television or radio announcers 
speak about 150 to 160 words per minute. Our top reading speed 
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is some 720 words per minute (Lawson, 1968.) Text, spoken and 
written, is always linear and must be processed sequentially, 
word by word. It takes a long time to convey a verbal message. 
Non-verbal information, howevei, seem to be processed very 
fast. It only took a few seconds for adult subjects to recognize 
"two birds" when shown a picture of two flying House Martins. 

The perception process is often assumed to consist of two 
stages. Information processing is tentative, fast, rough and 
parallel in the first stage. It comprises all kinds of analysis, from 
physiological to cognitive processes. A number of different 
properties of a stimulus are identified simultaneously. In many 
instances, one such analysis is sufficient. 

The second stage of the information analysis is conscious, 
demands attention, is detailed and sequential. Various hypotheses 
about a stimulus are weighed against one another and tested. 
Information processing is more definite on this level. 

Color blindness, or better "Anomalies of color vision", is a 
condition in which certain color discriminations can not be made. 
It is much more commonly observed among men than among 
women,with estimates ranging as high as 8-10% of the male 
population Only 1% of the female population has anomalous 
color vision. Most common is She problem to distinguish benvet 
red and green. Unfortunately, red and green are quite often used 
as discriminating symbols in our modem society. 

In the torrent of information that bombards us we have to 
select the information we want. So one of the main problems in 
advertising today is to reach people with the "message". One 
calculation has shown that Swedes are exposed to 1600 
"messages" every day. We register 80 and react on 12 of these 
messages. Obviously there is an information overload. In view of 
our limited capacity for handling simultaneous information, it is 
important to find out which factors determine the parts of the 
available information that will be processed. Which stimuli do we 
select and why? When we first look at a visual we only see that 
which is necessary to perceive and identify objects and events in a 
reasonable and meaningful manner. This is Gibson's "principle of 
economy" (Gibson, 1966). 

Acceding to Biody (1982) preference for a particular visual 
format does not necessarily result in increased learning. Yet, in 
the aosence of more substantial data, information based on 
student preference has a meaningful role to piay in affecting 
learning. 

Getting and keeping a readers attention may be improved by 
using differL^nt design variables such as color, changes in 
brightness, varying the size of a particular pictorial subject. 
Attention getting techniques are used extensively in advertising. 
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Vogel et. al. (1986) showed that it is undeniable that visual 
presentation support is persuasive. Presentations using visual aids 
were 43 percent more persuasive than unaided presentations. 

The perception system strives to obtain clarity. If thie system 
arrives at clarity then clarity serves as a reinforcement, a reward. 
So our perception of an image depends on our previous 
experience, our mood, other pictures, text and sound, our 
personal interests etc. 

When we look at a visual, we also "see" different details in 
the visual on different occasions. So highly "saturated", 
information-packed visuals may have something new to offer 
even after having been viewed tens of times. 

We have to learn to read and comprehend the content of an 
image. According to Salomon (1979) the process of extracting 
information from messages that are presented in any symbolic 
format involves mental activities. In order to match between the 
symbols and their referents in the learner's cognitive schemata 
translation activities are needed. Such processes differ as a 
function of the symbolic systems used to convey the message. 
Tidhar (1987) studied children's understanding or he content in 
educational television programs. It was concluded that "Channel 
Dominancy", the degree to which either ti.e visual or the auditory 
channel carries the brunt of information whereas the other channel 
provides compatiL^le supportive information, was found to affect 
viewer's information processing in areas such as recall, 
comprehension, generalization and inferenrial activity. 
Equivalence in verbal and visual information was found 
significantly superior to verbal or visual dominancy in its effect 
on spontaneous recall. Presentations characterized by visual 
dominancy or equivalence in verbal and visual information were 
found significantly more comprehensible than presentations 
characterized by verbal dominancy. Visual dominancy was 
revealed to have the highest positive effect Oii gen^^ralizations, 
followed by equivalence, whereas verbal dominancy 
piesentaiions achieved the lowest generalization scores. The effect 
of channel dominancy on inferential activity interacted with the 
viewing condition: when viewers were exposed to the visual 
channel only, visual dominancy elicited a higher degree of 
inferential activity than the presentations characterized by verbal 
dominancy or equivalence. 

According to Lanners (1973) we only see the things that 
affect us emotionally. Everything else is ignored. When we look 
it a picture, we first discover the ci^es we already recognize. We 
probably become most easily familiar wi.h simple patterns than 
with complex patterns. Closed shapes are preferred to open 
shapes and fields. Once we have identified a few well-known 
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shapes, we sometimes feel that we have "seen everything" and 
could w ell miss some valuable infomiation. 

Thurstone and Carraher (1966) points out that some 
structures will be perceived as reversible when it is hard to choose 
between figure and background. Reality and what we see at any 
given moment will always be separated and different. We will see 
different things at different occasions both with respect to reality 
and pictures. 



The brain 

Verbal languages have digital codification with combinations of 
letters and/or numbers representing contents (Elkind, 1975). 
There is no d'rect correspondance between groups of letters, 
words, and reality. Each meaning is defined and must be learned. 
In contrast to this, non-verbal languages have analogical 
codification with combinations of basic graphical elements (dots, 
lines, areas and volumes) for likeness of a (concrete) reality 
(Pettersson, 1983 b.) Usually there is a correspondence with 
reality. Visuals are iconic. They normally resemble the thing they 
represent. Meaning is apparent on a basic level but must be 
learned for deeper understanding. Gombrich (1969) argues that 
no pictorial image gains the status of a "statement" unless an 
explicit reference ij> made to what it is supposed to represent. 
Barthes (1977) uses the term "anchorage" to describe the 
relationship of pictures to legends or other accompanying veroal 
language. Most pictures are capable of several interpretations until 
anchored to one by a caption. 

The modem era of brain research began in the mid-1960*s, 
when Dr. Roger Sperry and his associates published their 
findings regarding patients who were operated on to conrol life- 
threatening epileptic seizures ^see Gazzaniga and Le Doux, 1978; 
Wilson, Reeves and Gazzaniga, 1982; and Sinatra, 1986, for 
reviews.) Several researchers have given a lot of thought to the 
function of the brain. 

According to some theories, the two halves of the brain are 
apparently specialized and function independently of one another. 
At the same time, however, either of the brain halves appears to 
be capable of assuming the functions of tue other half. There is an 
immense communication between the two halves. It has been 
estimated at six billion pulses per second. 

Each half of the brain has its sensory perceptions, thoughts, 
feelings and memories. Thus the left half of the brain is said to be 
mainly verbal, capable of speech, counting and writing. It seems 
to be specialized in abstract thought, is analytical, logical and 
working linearly, detailed and sequential. It is controlled. 



dominant, critical, has established symbols processing, facile 
recognition, positive emoting, goaNoriented and developmental 
learning. It performs convergent search, is time sensitive, 
aggressive and controls the right half of the body. The right half 
of the brain is said to be speechless but capable of concrete 
thought, perception of "-^ace ah J an understanding of complicated 
relationships. It is saia to be knowing without words, holistic, 
spatial, intuitive, creative, minor and self-knowing. It is 
receptive, able to work with new symbols, will remember new 
faces, new data and is negative emoting. The right half of the 
brain is artistic, interprets auditory signals, emotional undertones 
and music. It is said to be immediate knowing. It is working with 
divergent search and is time-abhorrent. It can count only to 
twenty, is only capable of reading simple nouns and is unable to 
write. The right half of the brain is said to be completely superior 
to the left half of the brain in its perception of both two- and three- 
dimensional images. The right half of the brain also controls the 
left half of the body. 

Most certainly there is a lot of cooperation between the two 
brain hemispheres rather than compet'tion. Dual processing 
modes of the hemispheres are beneficial to the human being. 
Blood flow mapping during reading aloud has shown that seven 
cortical regions are active in each of the hemispheres (Lassen et. 
al., 1978.) 

According to Perfetti (1977) and Sinatra (1986) perception of 
linear representations, such as text, means a sequential, slow 
processing to compose and comprehend the content ("left brain 
activity".) Retrieval from verbal memory is a serial integration and 
sequential processing of auditory-motor perception systems 
(Sinatra, 1986.) 

According to Gazzaniga (1967) and Sperry (1973, 1982) 
perception of two- or three-dimensional representations means a 
parallel simultaneous, holistic and fast processing ("right brain 
activity".) Lodding (1983) concluded that the image memory and 
processing capabilities of the human mind are extremely 
powerful. Pirozzolo and Rayner (1977) suggested that word 
identification is a multi-stage process. Visual-featural analysis is 
carried out by the right brain hemisphere. Word naming and word 
meaning are processed by the left hemisphere. According to 
Sinatra (1986) the meaning of well-known phrase units may be 
accomplished without activating the auditory-motor speech 
system. This is said to be done by rapid interchange of 
information between the language centre in the left hemisphere 
and its n^n-verbal representation in the right hemisphere. 

Western societies have long placed a premium on the 
properties represented by a well-developed left half of the brain. 
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The design of our intelligence tests is usually such that residents 
of urban areas consistently record higher scores on the tests than 
residents of rural areas, middle-class people record higher scores 
than blue-collar workers and whiles record higher scores than 
blacks. However, one study recently showed that Australian abo- 
rigines were dramatically superior to white Australians in solving 
test problems when these problems were designed so that the 
right half of the brain had to be brought into play in order to solve 
the problems. So intelligence is linked to culture and cannot be 
defined with numerical values. The right half of the brain is said 
to be more developed than the left half of the brain in boys. With 
girls it is the opposite. At school children receive a good training 
of the left part of the brain. After a few years boys catch up with 
girls with respect to the development of the left half of the brain 
and remain superior with respect to the right half of the brain. All 
children should be able to develop both parts of their brains at 
school. More right-brain activities like drawing, handiwork and 
rhythm exercises are needed. 

Our Western society is dominated by the written v/ord and 
extremely quadrangular. It is a society in which bureaucrats 
occupy quadrangular cells in such a way that creative and 
intellectually lively people are perceived as disturbing and 
disruptive features of the prevailing order. New ideas are 
effectively stifled. This leads to stagnation, industrial crises and a 
breakdown of the social fabric. 

It is conceivable that some c ^ the fantastic success noted by 
the Japanese in the field of electronics and computer techuology is 
due to ;he circumstance that the Japanese, since time immemorial, 
have lived in a "pictographic" society and therefore think 
differently than we do in Western cultures. 

However, the development of new media will lead to a shift 
in our media consumption in the coining decades from "reading" 
and "listening" to "looking", i.e. in our consumption of 
"entertainment", "information", "education" and "news". Future 
generations are likely to grow up in a picture-dominated society, 
rather than in a text-dominated society. The unrestrained 
consumption of TV and video programs by children may lead to a 
drastic change in our cultural life and our perception of culture, 
human values and ethical norms. Even today we already know 
that the viewing of TV entertainment containing repetitious 
violence has an influence on our attitudes so that violence 
becomes more acceptable to us. This could lead in turn to 
antisocial attitudes and a-social or even criminal behaviour. We 
are faced by the prospect of major changes in our media 
consumption. Yet we still know relatively little about visual 
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language. It is important for society to make resources available to 
facilitate our transition from text-orientation. 



Picture perception 

It is known from several experiments that images are perceived in 
many different ways by various subjects (Pettersson, 1?85, 1986 
b). Even simple line drawings evoke many associations. Vogel et. 
al. (1986) showed that image-enhancement intended to improve 
interpretation of image content sometimes got in the way of the 
message. Thej concluded that image-enhancement graphics 
should be used selectively and carefully. When in doubt, they 
recommended, plain text should be used. Limburg (1987) pointed 
out that receivers have even more ambiguity or semantic diversity 
with visual images than with most expressions of written 
language with its manifold meanings. Lodding (1983) repoued on 
the problems with misinterpretations of icons used in computer 
systems. However, he concluded that people find a naturalness in 
dealing with images either as an aid to or, in some circumstances, 
as the sole means of communicating. 



Assignments 

To name image contents 

When Snodgrass and Vanderwart (1980) asked 219 subjects to 
name 260 simple line drawings with concrete image contents such 
as "a doll", "a finger", and "a trumpet," they found that 80 per 
cent of the pictures were given the anticipated answers. 

In one study (Pettersson, 1986b), 80 adult subjects were 
shown five illustrations. These concrete image subjects showed 
"two house martins in flight," "a young tadpole," "a squirrel with 
a nut between its front paws," "a gnawed spruce cone," and "a 
bird nesting box." In the following pages these drawings will be 
referred to as "the five illustrations." Subjects were asked to 
describe the content of each image. All subjects answered with 
very concrete and directly content-related, descriptive words. 
Usually two or three different words were used for each picture 
(table 1). 
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Tabl0 1. Answers to the question: "What is the content in this image? 



Picture 



Number 
of words 



Number of 
different words 



Frequency (%) for the 
most common word 



2 
3 
4 
5 



m 



80 
80 
80 
80 
80 
80 



3 
4 
2 
3 
2 
2,8 



46,3 
43.8 

92,5 
46.3 

73.8 
60,5 



n s 80 subjects. 400 words 

One of the five illustrations ("two house martins in flight") 
had been used in a previous study of eye- movements (Pettersson, 
1983a.) Within one or two seconds ("immediately") subjects 
recognized the concrete image content ("two birds" or "two flying 
birds") in the picture. This has also been true of other eye- 
movement experiments, for example Potter & Levy (1969). 

These results all indicate that there is an image interpretation 
mode in which the "whole" and "immediate", concrete contents of 
an image are perceived. 

To describe image contents 

Subjects have been asked to make descriptions of the contents of 
images (Pettersson, 1985, 1986b.) In one case, 80 subjects (other 
than those mentioned above) made brief descriptions of ten 
pictures, all intended to convey abstract image contents. Only 
some (12,5%) of these 800 descriptions contained the anticipated 
"key words." Each picture was described with several different 
descriptive words. The 80 subjects utilized 14^6 words which 
can be regarded as "key words." For each picture the number of 
different key words ranged from 31 to 51 with a ^ :an value of 
37,6. The four most common key words fo* each picture 
accounted for half of all the key word designations (51%.) Most 
of the designations were only mentioned once or a couple of 
times. 

In subsequent experiments, 80 subjects have made detailed 
descriptions of "the five illustrations." These descriptions 
comprised 15 to 300 words. Here too, a large variety of 
descriptive words were used. Mean values were between 59 and 
119 woros. 

To index image contents 

Copies of "the five illustrations" were also subsequently given to 
125 other subjects. Subjects were given the following task:"These 
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five pictures are to be filed in a picture archive. Write one or more 
index words for each picture." 

In this case, subjects answered with 40 to 51 different index 
words for each picture with a mean value of 43,6. A total of 1034 
words were used. The words expressed in the first study were 
always the most common in this test. On average they account for 
some 48 per cent of all the words used as index words for each 
picture. The three most common index designations for each 
picture accounted for half of all the index designations (52,5%.) 
Most of the designations were only mentioned once (51,8%) or 
twice (17,4%.) Concrete, descriptive designations dominated. 
Thus this study confirms the findings from the previous study 
with brief descriptions. 



Table 2. Answers to the task: "These pictures are going to be put in a picture 
archive. Please write one or more index-words for each image." 



Picture 


Number 
of words 


Number of 
different words 


Frequency (%) for the 
most common word 


1 


281 


44 


30,6 


2 


162 


40 


28,4 


3 


225 


42 


36,4 


4 


149 


41 


25,5 


5 


217 


51 


32,3 


m 


207 


43.6 


30.6 



n x= 125 subjects, 1,034 words 



A comparison of the results presented in the two tables (1 and 
2) shows that an average of neaxly sixteen times more words were 
used in the latter case (n,.an values were 43,6 and 2,8). 

The suggested index words can be organized into various 
hierarchic structures with abstract and concrete words, as well as 
synonyms and near synonyms. Several of the words that were 
used clearly show that the images have been carefully studied. 

These results all indicate that there is an image interpretation 
mode in which details and the abstract contents in an image are 
perceived. 

To write legends 

Ten pictures where subsequently shown to some 80 students 
taking a course in visual communication. The students were asked 
to compose legends which were 1. positive and reinforced image 
contents, 2. negative and weakened image contents and 3. neutral 
and neither reinforced nor weakened image contents. Subsequent 
reviews of the legends (appr. 2,100) and also discussions in class 
showed that picture legends clearly have an ability to affect our 
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perception of the image content. Actually the legend has a very 
great impact on our image perception. It might said that "to a 
large degree readers see what they are told to see in an image" 
This is also shown in eye-movement studies (Pettersson, 1986c). 

To rank and rate images 

Experiments with rankings and ratings of pictures (Pettersson, 
1984) showed that picture readability is positively correlated with 
both aesthetic ratings and assessed usefulness in teaching. 

To assess image contents 

In one study (Pettersson, 1985) 46 "senders'* as well as 80 
•'receivers" assessed image contents. Results slowed that for 
seven out of ten pictures there was a significant difference 
between the intended and the perceived image content The above 
pictures were all mounted on cardboard paper in the A3 format 
(29.7 X 42 1 centimetres). In a follow-up si idy slides were made 
of the five drawings. These slides were then shown to and rated 
by 1 13 adult subjects at the UREX image laboratory in Finland. 

In the first study, a seiiiantic differential ocale was used. The 
verbal ratings 'Very poor," "rather poor," "neither poor nor 
good," "rather good" and "very good" were supplemented with a 
numeiical value from zero to one hundred. For practical reasons a 
Likert scale ("very poor," "rather poor," "rather good" and "very 
good") had to be used in the second study. Thus results from the 
two studies are not exactly and immediately comparable. 
However, these two studies show a remarkable similarity of 
results (table 3). In both cases pictures were rated very much the 
same. In this case it can be concluded that content was more 
important than format. 



Table 3. BesuHs 


from assessments of image contents. 


Image content 


1:papet-;r 


nages 


2: slides 




rating 1) 


s 


rating 2) 


credibility 


56 


26 


59 


togetherness 


65 


z: 


64 


courags 


67 


20 


63 


suspiciousness 


74 


16 


74 


aggresSiOn 


76 


19 


79 



1) mean ratings for 80 subjects (according to a semantic differential scale G - 
100, where the interval 60 - 80 is designated "rather good" ) 

2) percent of 1 13 subjects who rated the image as "rather good" or "very good" 
according to a Likert scale ("very poor," "rather poor," "rather good* and " vary 
good") 
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To create images 

In four different experiments, art and design students in Sweden 
have been assigned the task of making pictures according to 
various instructions (Pettersson, 1984, 1985 and 1986b.) These 
experiments resulted in a variety of pictures (almost 600.) There 
is no doubt that an intended content can be expressed using many 
difrerent images. It is also quite clear that different people 
perceive and depict a given text in widely differing ways. Content 
is more important than format. 

In visual language, non-meaningful basic elements (dots, 
lines and areas) are put together into shapes which are combined 
into syntagms or sub-meanings (Pettersson, 1987.) Syntagms can 
be part of complete meanings which in turn can be sub-meanings 
to other complete meanings. The basic elements can be put 
together in different ways, thus forming different images. 

In an experimen% subjects were given three sets of basic 
elements. They were given the assignment "Combine the basic 
elements on each piece of paper into an image." The efforts 
resulted in three series of pictures which were very different in 
their execution. According to image contents the pictures were 
grouped in vaiious categories (table 4). Contents comprised 
groups like eye, cat, bird, face, animal, person and also abstract 
ones (27%.) The basic elements had been produced by taking 
original pictures apart electronically. The elements were mixed in 
a new way and some got new orientations before they were 
printed our in hard-copy formats. 

Tabie 4. Results of the assignment. "Combifte the basic elements on e^'^h 
piece of paper into an image." 

Set of oasic Number of Frequency with the 

elements image categories intended image content (%) 

1 (eye) 6 20 

2 (cat) 5 26 

3 (bird) 6 12 

n1 = 65, n2 = 50 and n3 = 50 subjects 

!t can be concluded that a given set of basic elements can be 
combined to form various completely different images. 

The same subjects were also given a picture in which they 
were asked to use white ink and eliminate one hundred dots 
without changing the image contents. They all succeeded. Results 
fully confirmed earlier findings (Pettersson I986d). We can 
delete, add or shift information in an image without drastically 
affecting perception of image contents . 
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To complete a story 

In comic strips the verbal information is carefully integrated into 
the % isuals. Voice balloons indicate a dialogue and a sequence in 
time. Characters in a comic strip may be compared with actors in 
a movie or in a TV-program. The reader may get the impression 
that 3 story takes place while reading it. 

During the summer of 1986 large Fanta bottles sold in 
Sweden had one of three different comic strips with popular 
Disney characters printed on the back of the labels. Each story 
consisted of four pictures and traditional balloons (in two cases). 
Soft drink buyers were asked to complete each story by writing a 
text in the balloon(s) In the forth picture. The labels were sent to 
an advertising company. After a while some people were given T- 
shirts as gifts. However, the texts were not meant to be used for 
advertising. The texts should just end the stories. On request all 
2,490 labels were donated to me for an analysis of the texts. The 
comic strips were grouped according to age groups and gender of 
the subjects. After this procedure names and addresses of the 
subjects were destroyed. All texts were then written into a 
computer system for subsequent analysis. The texts can be 
described as very simple. On average the LIX-value is 15.6. The 
total number of sentences is 4,500 with an average of 6.4 words 
of four letters. On average only three percent of the words des- 
ignating meaning are used more than ten times, and 91 percent are 
used less than five times. Thus the distribution of words with 
meaning is very similar to the average frequency of index words 
in the previous study "To index image contents". There is no 
difference between the texts created by female or male subjects 
wi.h respect to statistical measurements (table 5). Results showed 
tliat most subjects had their own ideas on how to finish the story . 



Table 5. Answers to the assignment: "Complete the story." 



Variable 


Donald 
f m 


Mickey 
f m 


Goofy 
f m 


Number of subjects 


469 


403 


520 


393 


•M8 287 


Number of sentences 


764 


613 


530 


677 


1173 743 


Ave, number, of words/ 
sentence 


5.9 


6.1 


6.6 


6.4 


6.3 6,8 


Ave. word length 


3.9 


3,9 


4.0 


4.0 


4,0 4.0 


Number of diff. words 
carrying meaning 


497 


524 


613 


669 


646 572 
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Occasions, of the most 

common word 54 52 77 111 144 93 



Frequency of words 3 2 2 3 6 4 

that are used in more 
than ten sentences (%) 

Frequency of words that 91 94 94 92 88 89 

are used in less than 
five sentences (%) 

LIX-value 12,0 12,5 15.4 16,0 18,6 19,1 

f = female subjects, m = male subjects 



To illustrate a story 

It is interesting to study the pictures in different editions of fairy- 
tale books (or movies...) Different artists all have their individual 
styles of work. They also have their own ideas of what to select 
and how to emphasize interesting contents. It is an obvious fact 
that our perception of a story is very much depending on the 
illustrations that are selected. 

To produce informative materials. 

In one experiment (Hellspong et. al. 1987) groups of students at 
the University of Stockholm were assigned the task of producing 
informative materials in different versions. After production 
senders as well as receivers assessed all the 29 versions of 
information materials according to the 0-100 semantic differential 
scale. Results showed that there were major differences between 
intended and perceived levels of quality for the four examined 
variables "text,", "visuals,", "graphic design" and "total 
impression." The average level of intended! quality was higher 
than the perceived levels, i.e. the senders rated their material more 
favourable than the receivers. Perceived quality was better than 
intended quality only in about 15 percent of all 1 16 assessments. 



Table 6. Results from assessments of "good" informative materials. 



Variable 


Intended value 
(senders) 


Perceived value 
(receivers) 


Difference 


text 


81 


59 


22 


visuals 


83 


55 


28 


graphic design 


75 


61 


14 


total impression 


84 


59 


26 


n= mean assessments for 12 groups of students 
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Describing picture context 

In communications, the sender is anxious for different receivers 
to perceive her/his message in the same or similar ways. But this 
is seldom the case. Major discrepancy between the sender's 
perception and the individual receiver's perception is very 
common. A picture always represents a choice, a "frozen" slice of 
time. Something is always going on around, before and after a 
depicted event. 

In one experiment, adult subjects wer^ asked to draw pictures 
depicting events in the enclosed field around a small, very simple 
illustration (test pictures 1-6). They were also asked to draw 
pictures depicting the events they considered to take place 
"before" and "after" each picture (test pictures 7-10). 




9a 



9 b 



1 0 



Each subject worked with a total of ten different tasks (and produced 1 1 
pictures). 



As expected, subjects had very definite and differing 
opinions about what was probably going on around particular 
pictures and about events prior to or after a depicted situation 
(designated above with a "?"). 

For the first assignment, 38 subjects drew an average of 22 
different depictions of the picture's contextual events (table 7). 
On the average, seven different motifs were drawn by more than 
one subjects. The most common motif was selected by an average 
of seven persons. Most subjects (82%) ignored the inner frame 
when depicting context. However, the inner fi^me was utilized as 
significant image element in the composition of 42 pictures. The 
inner frame was then incorporated as e.g. a window, painting, 
poster, book page, aquarium or cinema screen, to mention just a 
few. Context merefore governed the size of the original motif. As 
regards the second assignment (test picttures 7-10), 30 subjects 
produced an average of 12 depictions of events preceding and 
following each picture (pictures, in one instance). On the average, 
six different motifs were drawn by more than one subject. The 
most common motif was selected by nine persons. 

The results showed far closer agreement between the 
subjects' perception of events "before - after" than of events 
"around". The latter produced fewer motifs (40% vs. 58%. In 
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addition, the most common motif was represented in more 
pictures (30% vs. 18%). However, the number of motifs drawn 
by more than one subject was about the same for both 
assignments (20% vs. 18%). 

Table 7. The number of motifs created around (1-6) and before or after (7-1 0) 
displayed test pictures. 

Stimulus No. of No. of motifs No. of drawings 

(test picture) different depicted by of the most 

motifs more than 1 corimon motif 

subject 



1 swallow 


25 


8 


4 


2 cat 


20 


8 


5 


3 fish 


17 


6 


6 


4 dog 


24 


6 


9 


5 mushroom 


19 


7 


8 


6 boy 


25 


4 


7 


ml-6 


22 


7 


7 


(m 1-6)IOO:n1 


58 


18 


18 


7 boat 


12 


8 


7 


8 cloud 


9 


6 


11 


ga swaltow 


11 


4 


13 


9b swallow 


11 


5 


10 


10 truck 


16 


6 


5 


m7-10 


12 


6 


9 


(m7-10)100:n2 


40 


20 


30 



n1=38 for 1-6 (i.e.228 pictures) and n2=30 for 7-10 (i.e. 150 pictures) 



The results show that the subjects have treated the visual 
information in a conscious and analytical manner. The results 
suggest that each subject placed available information in a wider, 
expanded, "personal" context. All the interpretations were 
realistic and about equally credible. We are apparently capable of 
sensing far more information than is explicity displayed in a given 
picture. Adult perception tends to be holistic rather than detail- 
oriented. No one, except the picture creator, can state with 
absolute certainty what is really going on around a particular pic- 
ture's events or what really happened before or after the situation 
depicted in a picture. All the subjects still expressed opinions 
about circumfluous events on their drawings. They also tended to 
feel that their particular interpretations were the correct ones. 

So consensus about the way a picture's explicit and implicit 
contents should be perceived is extremely limited. Opinions about 
implicit context are even more wide-ranging. Every picture can be 
said to possess an "individual interpretation dimension" which 
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depends on available stimuli (the signs used to form the picture, 
the faithfulness of depiction, etc.) and the individual viewer's 
cognitive capacity. Since people are different, pictures will 
always be interpreted in different ways. 

Approaches to picture perception 

There are many approaches to picture perception. Based on the 
theory of linear perspective, invented during the Renaissance, 
Gibson (1971) defined picture perception as a stimulus-driven 
process in which information is picked up from optical array. The 
opposite view is held by Gombrich (1969) and Gregory (1978.) 
While seeing a picture the viewer constructs a meaning based on 
experience and expectations. From this receptionist position 
neither the readers or the message remains the same. Meaning 
exists only for a moment witnin each individual reader. Another 
approach to picture perception is based on semiotics and symbol 
theory (Goodman, 1976.) Intentionalism suggests that meaning is 
embedded in the message by a producer, leaving the reader to 
discover and unfold it. From this perspective meaning exists 
independent from the reader. For an intentionalist a painting 
means what the artist says it does. For a receptionist the painting 
does not mean anything until the reader says it does (Muffoletto, 
1987.) Boeckman (1987) makes a clear distinction between 
drawings and paintings, which have "signs" and photographs 
which have "recorded perceptional stimuli." "Before photography 
was invented there were two modes to learn about reality. 
Perception processing stimuli of ;he surrounding reality on the 
one hand and communication processing signs on the other. Now 
we have something in between: Recorded perception stimuli 
which are not reality but not signs either". And for Arnheim 
(1974) picture perception is a matter of responding to basic forms 
such as gestalt laws. An important point of Arnheim's is that 
visual perception includes the same behaviours that we commonly 
consider only as matters of cognition or thinking. A "percept" is a 
building block of visual thinking and as such analogous to the 
cognitive function of a concept. 

The perception process is often assumed to consist of two 
stages. A fast overview is followed by a conscious analysis. 
When we first look at an image we only see that which is 
necessary to perceive and identify objects and events in a 
reasonable and meaningful manner. This is Gibson's "principle of 
economy" (Gibson, 1966.) 

Simple line drawings accompanied by various assignments 
caused very different reactions in subjects. It is obvious that the 
different assignments have caused perception and image 
interpretation on different cognitive levels. It may be suggested 
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that image interpretation on low cognitive levels follows these 
steps: 

1 The subject looks at the image. A few rapid eye fixa-tions are 
made. 

2 The information is handled as a "whole" in parallel, 
simultaneous, tentative, rough, holistic and fast pro-cessing. 

3 A "wholeness interpretation" occurs, recognition and meaning 
of the image content is formed very quickly - "immediately." 

4 This interpretation is expressed by the use of a very limited 
number of words. 

It may also be suggested that image interpretation on high 
cognitive levels follows these steps: 

1 The subject looks at the image. A few rapid eye fixations are 
made. 

2 The information is handled as a "whole" in parallel, 
simultaneous, tentative, rough, holistic and fast processing. 

3 A "wholeness interpretation" occurs, recognition and meaning 
of the image content is formed very quickly "immediately." 

4 Certain details in the image attract more eye fixations. 

5 The information is processed again, maybe several times, 
detail by detail. The process demands attention and is 
sequential. 

6 Our verbal memory is activated in a search for suitable 
expressions. Various hypotheses about the image content are 
weighed against one another and tested. Segmented codes 
have to pass through several levels of recognition and 
interpretations before meaning occurs. 

7 The interpretation of the image contents is expressed by the 
use of a large number of different words. 

In both cases, I believe, both halves of the brain are involved in 
the interpretation of image contents. In the first case there might 
be a dominance of right brain activity. However, in the other c^^*^*^ 
there might be a dominance of left brain activity. Interpretation oi 
verbo-visual information such as a television-program is likely to 
take place simultaneously in both parts of the brain. How we 
actually create meaning is an area where much research still is 
needed. 
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high 



cognitive level 





analytic image 
interpretation 




low 



immediate image 
interpretation 



An image is interproted in different ways depending on the assignment. 
It can be concluded that: 

- Perceived iMage content is different from intended image 
contents. 

- Different assignments may cause different interpretations of 
image contents. 

- Some assignments cause interpretation of image con-tents on a 
low cognitive level. 

' Some assignments cause interpretation of image con-tents on a 
high cognitive level. 

- Even simple pictures may cause many different associations. 

- A given set of basic elements can be combined to form 
completely different images. 

- The design of a picture can be changed a great deal without 
any major impact on the perception of the image contents. 

- Content is more important than execution. 

- Kcture readability is positively correlated with both aesthetic 
ratings and assessed usefulness in teaching. 

- Legends should be written with great care. They heavily 
influence our interpretation of image con-tent. 

- Content is more important than format. 

- To a large degree readers see what they are told to see in an 
image. 
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- There seem to be no major difference between gender in 
interpretation of image contents. 

- Most subjects have their own ideas on how to finish a story. 

- There are major differences between intended and perceived 
levels of quality in informative materials. 

- Computer-based indexing systems should rely on full text 
image descriptions. 

- How we actually create meaning is an area where much 
research still is needed. 

Message design 

Seeing pictures, a movie or TV program, clearly seem to be an 
active process. Some of the retina's 125 million sensory cells 
record the light impulses by chemical conversion of visual purple, 
signals are transmitted to the cortex and the cortex converts the 
signals into a sensation of vision. In the case of movies and TV 
program, dialogue, music and sound are additional effects which 
are transmitted by the auditory apparatus to the brain where they 
are incorporated into a unified perception of the total information. 
We must never commit the error of confusing still pictures, 
movies or TV programs with reality. They are only 
representations and always render a subjective, selective view of 
reality. Some general principles of information message design to 
be used in instruction may be given on the basis of different 
research results 

- Introduce novel or unexpected events at the start of instruction. 

- Inform learners of expected outcomes. 

- Recall relevant prerequisite information. 

- Present only relevant information. 

- Organize content and present "organizers". 

- Progress from simple to complex. 

- Provide prompts and cues. 

- Vary information presented. 

- Present examples and non-examples. 

- Provide appropriate practice. 

- Provide immediate feedback or knowledge of results. 

- Review and repeat. 



A cognitive model 

An outline of a cognitive model to clarify differences between the 
concepts "see - kok - read" and "hear - listen" is presented 
below. The model Suould be viewed as a theoretical device, based 
on empirical findings and extensive research on eye movements 
and fixations as summarized above (Eye movements), clearly 
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showing that we are capable of perceiving picture contents in 
many different ways . 

A single fixation of a picture is sufficient to enable us to 
recognize it subsequently among other pictures. If we e.g. go 
shopping in a department store, we are virtually unaware of the 
large number of advertising pictures/messages and background 
music to which we are exposed in the store. Everything merges 
into a kind of "noise". We probably only process most of the 
stimuli in this noise on a superficial level. We see and hear but do 
not look or listen. When we listen to the radio while engaged in 
some other simultaneous activity, such as cooking a meal, fixing 
a punctured tire or glancing through a newspaper, we are aware 
of words, music and images. Looking at a picture consumes more 
mental energy and demands a higher cognitive level than merely 
seeing a picture.Visual impressions are conducted from the 
sensory to the short-term memory, i.e. operative memory. We 
only become aware of the information which succeeds in passing 
through the brain's filtering system. Most of the information 
disappears after a while. 

When we e.g. study material in books or on TV we process 
that material actively. We read texts, listen to music and read 
pictures. Perceived information is processed, sorted and stored in 
certain parts of the brain's long-term memory. Many fixations of 
a picture are required for people to recall it subsequently and e.g. 
be able to describe it. 

Conscious analysis of linguistic messages, such as texts, 
music and pictures (e.g. research), probably demands an even 
greater consumption of mental energy and a higher cognitive 
level. The brain actually uses about one fifth of our daily 
consumption of energy, that is more than a hectogram of glucose. 

The most demanding processes are those leading to the 
creation of text, music and pictures. Creative people have often 
described the mental effort which is often associated with 
creativity. The model assumes the existence of a dynamic 
relationship in which we consciously and unconsciously switch 
cognitive levels. 

Our sensory organs respond to changes in our environment. 
We are normally capable of resolving changes with a gradient 
greater than about two percent. But we adapt to slow, gradual 
changes and often fail to notice them. So our senses are normally 
in the resting state but have a rapid response capability. In the 
corresponding manner, we are unable to remain cn the highest 
cognitive levels for more than relatively brief periods of time, 
since this would otherwise be too enervating and lead to some 
form of mental "cramp". Like a pike lurking in the reeds or a cat 
poised outside a mouse hole, we know what our surroundings 



look like. When changes occur in those surroundings, we are 
capable of responding rapidly and powerfully by activating our 
bodies both in physical and mental terms. Sometimes, everything 
goes according to plan. The pike gets a minnow, the cat gets its 
mouse and we find the information we are looking for. At other 
times, efforts may fail. A predator may miss its prey, and we may 
spend a great deal of time and energy gathering information which 
turns out to be useless. 



Cognitive level 

' 7' 

Creating text, 
music and pictures 



Analyzing text, 
music and pictures, 
e.g. research 



Reading text, 
listening to music 
and reading pictures, 
e.g. studying 



1*^ 



Locking at text, 
hearing music and 
looking at pictures, 
such as inactive 
-TV viewing 

Being aware 
of the presence 
of text, music and 
pictures, e.g. 
while shopping 



Mental energy consumption 



The relationship between cognitive level and mental energy consumption in 
different activities. 

No clear distinctions can be made between the five cognitive 
levels discussed here. But there are probably major differences 
between individuals due to cultural, social and personal factors. 
So the model should not be interpreted too literally. However, it 
can be employed to elucidate the fact that there are major 
differences between the concepts "see - look - read" and "hear - 
listen". Active reception of linguistic intelligence comprising text, 
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sound or pictures, individually or in concert, always requires 
exertion. Reading and listening are mentally and physically ex- 
hausting. Uninteresting or poorly designed material reduces our 
interest in the subject described by that material. So the sender of 
a message should strive to design text, music and pictures in the 
most attractive, relevant manner possible so receivers are 
encouraged to process the message on the highest possible 
cognitive level. 

This should be the case irrespective of whether the "messa^je" 
involves ^'information*', "entertainment", "education" or "news". 
The principles applies irrespective of the medium involved, 
although different media transmit messages from senders to 
receivers in completely different ways. 

Cognitive level 




///// 

^ graphical text (books, magazines etc.) 

/ / / / 

• graphical iniagGs(books, 
magazines etc.) 

/ / / 

text read aloud (radio) 

/ / 

music (radio, phonograms) 

/ 

sound and pictures 
(movies, TV, video) 



/ 



Suggestive impact 

The relationship between cognitive level and suggestive impact for different 
kinds of representations. Suggestive impact increases as the cognitive level 
increases. Writing a text may have a yreater suggestive impact than viewing a 
completed film or TV program. Creative nvolvement in the making of a movie or 
TV program may have a very considerable suggestive impact and evoke 
powerful emotions. 

Compared to a book an interactive computer program, 
phonograms, films, TV and videograms have a highly 
manipulative effect on receivers. Message contents change 
continuously in a predetermined manner with respect, to subject 
selection, time and space. The receiver's active efforts to seek 
information are therefore largely disabled. A reader can "digest" 
the textual and visual contents of a book at a self-selected pace. In 
a structured information context, i.e. lexivision, the reader is able 
to process information in about the same way as in a "natural" 
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situation. This is probably the reason why lexivisual information 
seems to work so well in practice. For example, interactive 
videograms are now possible with the aid of a computer. Here, 
the advantages of using sound and moving pictures can be 
combined with a high degree of user involvement. Interactive 
videograms will encourage and demand activity on a high cogni- 
tive level and should therefore be effective .n information transfer 
and learning. Interactive videograms can be viewed as three- 
dimensional lexivisions. 

The aforementioned discussion could conceivably explain 
why pictures have such an impact and a much greater abilUy to 
influence us than e.g. a text. Children are r*iore easily frightened 
by watching an act of violence on TV than by reading about the 
same act in a book or newspaper. This is because things we see 
appear to be more "real" than things we merely read about and 
because a higher cognitive level is required for reading than for 
seeing. Many scientists, such as Troger (1963) and Noble 
(1975), have shown that small children are incapable of actively 
processing the contents of and understanding contexts in a TV or 
video program. This is something most parents of small children 
have also experienced. 

Just as we learn to read texts, we can also learn to "read" pic- 
tures .Tailoring pictorial language in all media is therefore essential 
so the degree of "reading" difficulty increases progressively in 
e.g. school textbooks. It is reasonable to assume the following 
regarding informative and educational pictures: 

- A picture which is easy to read and understand conveys 
information better and more readily than a picture which is 
difficult to read and understand. 

- A picture 'jvoking a positive response conveys information 
better and more effectively than a picture evoking a negative 
response - when motivation is identical in both instances. 

- A "poor" picture may work well when motivation is high, but 
a "good" picture would then work even better. 

- An easily read picture can be assumed to have a greater 
functional, communicative impact than a picture which is 
difficult to read. 
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Learning and memory 



Learning 

The ability to read and understand pictures is learned. This 
learning takes place more rapidly in a culture where pictures are 
used and seen frequently. 

Learning must always be an active process. Just sitting 
passively and receiving informat;on is not a particularly effective 
learning method. It must not be assumed that "disseminated" 
information is the same as "received" information. In language 
teaching, it has been found that a foreign word has to be repeated 
an average of 34 times before it has been learned. Learning 
should take place in a natural situation to the greatest possible ex- 
tent. 

An old teaching principle states that you should first tell your 
students what you plan to tell them. You then tell them what you 
wanted to tell them. Afterwards, you tell them what you have just 
told them. An old Chinese proverb states the following: 

That which I hear, I forget. 
That which I see, I remember. 
That which I do, I understand. 

These old observations from reality have been confirmed by a 
number of different studies. We now know with great certainty 
that representations, such as text and pictures, sound and pictures 
or sound, text and pictures with redundant or iclevant relation, 
provide the basis for much better learning than sound, text or pic- 
tures alone. We also know that representations with irrelevant or 
contradictory commentaries make for poorer learning than sound, 
text or pictures alone. 

Bloom and colleagues (1956) proposed three domains of 
learning, the cognitive domain, the psychomotor domain and the 
affective domain. Gagne and Briggs (1974) identify five types of 
learning which they call Human Tapabilities. These are, a) 
intellectual skills, b) cognitive strategies, c) information skills, d) 
motor skills, and e) attitudes. 

The ability to recognize stimuli develops with age. Kids in all 
ages recognize visual stimuli better than auditory stimuli. 

We all develop our individual behaviours while we are 
learning. The expression "learning style" refer to these individual 
preferences. These preferences concern our environment, like 
sound, light, temperature, moisture and design of the room, our 
emotions and our sociological, physiological and psychological 
situation. We receive and process information from our sensory 
systems in various ways. Preferences for different kinds of in- 
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formation or "modalities" do exist. Thus people may have visual, 
auditory, kinesthetic and/or tactual modality. Some people have a 
mixed modality. 

In the US it has been found that 30 percent of elementary 
school children have visual modality, 25 percent have auditory 
modality, 15 percent have kinesthetic modality. The remaining 30 
percent have a mixed modality (Duffy, 1983.) 

Children with visual modality rely very much on seeing 
things and on their internal visualization. They learn by seeing, 
they are "visual learners." Thus these children remember faces 
rather than names. They must take notes and write down verbal 
information if they need to remember it. Visual modality children 
are very quit. They can not listen for a long period at a time. Vi- 
sual learners have vivid imagination. They think in images and 
visualizes in components and details rather than the whole. Visual 
learners are not particularly responsive to music. 

Children with auditory modality rely very much on hearing 
and verbalization. They learn by hearing, they are "auditory 
leamers."Thus these children remember names rather than faces. 
They learn from verbal directions and descriptions. They think in 
sounds. Auditory modality children talk a lot. They like to hear 
their own voices. Auditory learners miss significant details in 
pictures. However, they may appreciate a work of art as a whole. 
They favour music. 

Children with kinesthetic and/ or tactual modality rely very 
much on their movemenis and muscular involvement. They learn 
by doing and remember what was done rather than seen or heard. 
Imagery is not important, nor pictures. Kinesthetically oriented 
children prefer sculptures which they can touch. When communi- 
cating these children use a lot of bodily expressions. They 
respond to music by physical movements. 

Children with niixed modality strength learn from visual, 
auditory as well uo xvinesthetic and tactile stimuli. 

It is important to consider these various learning styles when 
we are producing instructional materials. Such materials should 
have a good balance between verbal and visual messages and 
maybe also suggestions for practical, hands-on-exercises. 

A verbal response to visual stimuli or a visual response to 
verbal stimuli requires a transformation from one modality to 
another. Research concerning the effects of verbal as well as 
visual modalities shows that children pay more attention to visual 
than to verbal information. Zuckerman et. al. (1978) found that 
children tend to be more accurate in recognizing visual than au- 
ditory segments in television commercials. Hayes and Bimbaum 
(1980) showed pre-school children cartoons in which the audio 
track either matched or mismatched the visual information. In 
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both cases kids had a higher retention of the visual than of the 
auditory information. Pezdek and Stevens (1984) found that 
when children had to choose which of two incompatible channels 
to process they preferred the video channel. The auditory 
information sustains attention and facilitates comprehension. 
Pezdek and Hartman (1983) found that video without sound 
reduced comprehension among pre-school children. Rolandelli et. 
al. (1985) concluded that children used the auditory component of 
television to direct attention to important visual information, as 
well as to process auditory, especially verbal content. 

Dwyer (1978, 1982-3) and his associates have conducted 
more than 200 studies on the effects of pictures on the learning of 
factual information. The studies are based on a 2.000 word text 
and various sets of illustrations of the human heart. A variety of 
formats such as booklets, television and slide-audiotape 
presentations have been used. Pictures have been found helpful in 
identifying the parts of the heart, e g when visual discrimination is 
needed. It has also been concluded that line drawings generally 
are most effective in formats where the learner's study time is 
fixed and limited. More realistic versions of art work however, 
may be more effective in formats where unlimited study time is 
allowed. 

Locatis and Atkinson (1984) summarizes the principles of 
cognitive learning in the following points: 

Concept Learning 

1 Determine whether to present a definition. 

2 Present very clear, unambiguous examples of objects 
belonging to the concept class, and indicate the class name. 

3 Present examples that clearly are not of the concept class but 
potentially may be confused as class mem-bers. 

4 Provide practice/feedback in discriminating between positive 
and negative examples. 

5 Provide practice/feedback in distinguishing between more 
ambiguous positive and negative examples, depending upon 
the degree of discrimination requi-red. 

Principle Learning 

1 Ensure that students have learned prerequisite con-cepts. 

2 Indicate the relationships among concepts. 

3 Demonstrate, or have students demonstrate, the prin-ciple. 

4 Provide practice and feedback in demonstrating the principle. 

Problem Solving 

1 Ensure that students have learned prerequisite con-cepts and 
principles. 
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2 Present the problem. 

3 Provide direction and guidance. 

4 Provide problem-solving practice/feedback. 



Memory 

Common to all the phases of the analysis performed on incoming 
information is the need to store the signals for varying lengths of 
time so that the information processing can be carried out. The 
processes which carry out this information storage are referred in 
psychological terms as "memories". There are many models 
seeking to explain the function of these memories (See Sinatra, 
1986, and Levie, 1987, for reviews.) One way of viewing 
memory functions is based on information processing in several 
steps. 

The first of these steps is the sensory memory which carries 
out the storage of stimulus information on the peripheral level, 
i.e. far away from the brain. An example of sensory memory is 
the biochemical processes in the eye. The visual cells there 
possess some inertia and function therefore as a kind of memory. 
The sensory memory normally stores information for one half to 
one second (vision). Loftus, Shimamura, and Johnson (1985) 
showed that for one tenth of a second as much information can be 
extracted from this sensory memory icon as from the picture 
itself. The iconic memory (vision) and the econic memory 
(hearing) are closely related to the sensory memory. These 
memories precede the integration of signals from various sensory 
systems. 

After being processed in the iconic memory and the econic 
memory, some information is passed on to the short-term (or 
operative) memory (STM) where it is only retained for a brief 
period of time, i.e. not more than one to two seconds. A number 
of complex operations are carried out here during solution ot 
problems. But the short-term memory has severe capacity 
limitations. Any information to be retained in this memory must 
be repeated every few seconds otherwise it will be lost from the 
short-term memory. 

Information which has entered the short-term memory can 
proceed through a filter (reception) which selects the information 
to be passed on. Once this filtration has taken place and certain 
information units have been assigned priority over others, these 
priority units are given access to a P system (register) with a 
limited memory capacity. This is the point at which a person 
becomes aware of the stored information. All other non-priority 
information disappears, normally forever if it is not re-transmitted 
to the filter when the filter is able to accept the traffic. The filter 
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scrutinizes the information received from the outside world and 
identifies the special properties of this information. When the 
information involves e.g. aural signals, the filter notes whether 
the signal is strong or weak. When visual signals are involved, 
the signal is scrutinized for information on color, size, any 
movement etc. 

The information which passes the P system can proceed in 
different ways. The information can be stored in a long-term 
memory (LTD). This is what normally happens with the 
knowledge we do not need for the moment. This long-term 
memory then affects the selection filter so the filter makes 
selections related to previous experience. The long-term memory 
is what most people mean when they refer to the "memory". The 
long-term memory has carrying contents, episodic memories (i.e. 
recollections of events, feelings, experiences etc.), words, 
pictures, concepts etc. The short-term and long-term memories 
are actually theoretical models which cannot be related to any 
activity pattern or any particular anatomical structure in the human 
brain. The distinction made between the STM and LTM is 
probably too clear-cut. 

Information can also be passed on to an "output system" 
which emits signals to the muscles which are to carry out a given 
act. The information can be switched back from the P system to 
the reception or to the short-term memory. The information can 
also get lost 

Comparisons are sometimes made between the human brain 
and a computer. However, the brain differs in many ways from a 
computer. As a rule, a couiputer must be able to process 
considerably more information than a human in any given 
situation, since the computer program is unable to distinguish 
between important and unimportant information. The machine is 
therefore incapable of ignoring any information the way the 
human brain constantly does. This is one of the reasons why a 
person's ability to process sensory information is far beyond the 
capability of even giant computers, even though the individual 
processing steps are carried out much faster in a computer than in 
the human brain, about one million times faster. The dual-code 
memory model (Paivio, 1971, 1978) proposes a verbal system 
specialized for processing and storing linguistic information and 
separate nonverbal system fo spatial information and mental 
imagery. These systems can function independently but are also 
interconnected. Other memory models include a single-code 
approach. All information is coded as abstract propositions. 
Complex cognitive processing of information involves the use of 
both visual and auditory cues. According to cue information 
theory (Adams and Chambers, 1962) information that is shared 
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between channels facilitate learning. Cues that occur 
simultaneously in auditory and visual channels are likely to be 
better recalled than those presented in one channel only. Drew and 
Grimes (1985) showed that close coordination between audio and 
video improved audio recall of television news and that 
redundancy aided story understanding. 
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Numerous scientists, such as Nickerson (1965), Shepard 
(1967) and Standing et al. (1970), have shown that subjects are 
capable of recognizing previously seen pictures with very 
considerable certainty. After showing subjects 10,(XX) slides over 
a five day period. Standing (1973) reported recognition accuracy 
of 83%. Haber (1970) described our ability to recognize pictures 
as virtually perfect. According to Potter & Levy (1969), a person 
only needs to look at a picture for a second or two to be capable 
of recognizing it subsequently. Loftus (1972) found that the 
number of fixations governs our proficiency in recalling a picture. 
He found that pictures which subjects studied several times were 
recalled more readily than pictures which where studied less 
extensively. Brigthouse (1939), Haber & Erdelyi (1968), Haber 
(1970), and Nesbit (1981) studied just how much subjects really 
remembered about picture contents. They found that much more 
time was required for subjects to remember a picture than merely 
to recognize it. The fixations can be guided and determined by a 
picture legend or by a spoken commentary. Meaningful material is 
learned more easily and remembered longer than meaningless 
material. Thus, we are normally forced to make a continuous 
selection from the information which constantly bombards us. 
Paivio (1983) showed that our memory for pictures is superior to 
our memory for words. This is called the "pictorial superiority 
effect." It is also known that memory for picture- word 
combination is superior to memory for words alone or pictures 
alone (Haber and Myers, 19820 

By the mid-l970's it was well established that children's 
immediate, factual recall of simple fiction was improved when 
picture content was completely redundant with prose content 
(Levi & Lesgold, 1978). More recent reviews (Levie & Lentz, 
1982; Scallert, 1980; Levin et. al. 1987) substantiate the Levin 
and Lesgold conclusions. 

Levin et. al. (1987) discusses different functions of pictures 
used in prose. According to them four functions are "text- 
relevant". These are called representation, organization, 
interpretation and transformation functions. Illustrations arc 
representational when they serve to reinforce the majomarrative 
events in the text and "tell" the same story i.e. are redundant with 
the text. Representational pictures add concreteness to the prose 
since memory for pictorial materials is better than memory for 
verbal materials. 

Illustrations are organizational when they provide a 
framework for a text. They add coherence to the prose since 
memory for organized materials exceeds memory for unorganized 
materials. 
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Illustrations are interpretational when they clarify passages in 
the text that are difficult to understand. Interpretational pictures 
add comprehensibility to the prose since materials that are initially 
well understood are remembered better than materials that are 
more poorly understood. 

Illustrations are transformational when prose content is 
recoded into concrete form and related in a well-organized 
context. These pictures provide readers with a systematic means 
of retrieving the critical information. Transformational 
illustrations are designed to impact directly on reader's memory. 

After a meta-analysis of results from some 100 experiments 
on functions of pictures used in prose, published in 87 separate 
documents, Levin et. al (op. cit.) concluded that all types of text- 
relevant pictures facilitate learning from reading prose. There was 
an increasing learning effect from representational pictures 
("moderate"), organizational and interpretational pictures 
("moderate to substantial") to transformational pictures 
("substantial"). It was also concluded that when illustrations are 
not relevant to the prose content no prose-learning facilitation is to 
be expected, on the contrary there can be a negative effect. 

Rressley and Miller (1987) reviewed experiments concerning 
children's listening comprehension and oral prose memory. They 
concluded the following ordering of conditions with respect to 
their potency for affecting children's learning of prose: sentences 
only < sentences + single incomplete pictures (i.e. partial 
pictures) < sentences + two incomplete pictures < sentences + 
complete pictures. 

In conclusion results from several experiments show that 
when content is the same in visual, audio and print channels 
learning is maximized. Conveying information through both 
linguistic and iconic symbols makes it possible for the learners to 
alternate between functionally independent, though 
interconnected, and complementary cognitive processing systems. 



Inner images 

When we look at a visual or at an object this obviously results in a 
perception; we create an inner image. However, we do not require 
external stimuli to create inner images. It is enough to think about 
a specific object, a visual, a person or an event. Then we retrieve 
a "copy" of an inner image, stored in the long term memory, to 
the perceptive and cognitive level. It is known that inner images 
can result in physiological reactions that can be measured. 
Sportsmen are sometimes training menially before an important 
athletic contest. In their minds they make adjustments to fine 
details in their performance. They imagine themselves on top of 
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the winners' stand. Such a training session can be as demanding 
?s a real tiaining session. 




In -Thinking Visually" Robert H. McKIm (p.8) Illustrates the interactive nature of 
seeing, Imagining and drawing with a figure of this kind. The three partly 
overlapping circles symbolize the Idea that visual ihinking is experienced to the 
fullest wheTi seeing, Imagining, and drawing merge Into active Interplay. The 
visual thinker utilizes seeing, imagining, and drawing in a fluid and dynamic way. 
moving from one kind of Imagery to another. 

When we think about a non-specific object or a non-specific 
person we probably retrieve "copies" of visual elements like dots, 
lines areas, colors, shapes, patterns etc. to the cognitive level and 
then combine them to form inner images. These inner images are 
representations of reality as visuals are. However, when we think 
about something non-existent, e.g. when we are creative, we can 
combine copies of existing visual elements with images stored in 
the long-term-memories to form completely new images of our 
own. These images are not representations of reality, since the 
objects, or whatever content the images have, are non-existent. 
However, such images can be transformed and transferred to 
drawings, paintings, models etc. These visuals do not represent 
reality as we know it but the artist's inner images or "inner 
reality". 

Many persons can "see" and experience complicated inner 
images, e.g. in dreams when external stimuli are shut out to a 
large extent. During sleep, the righi half of the brain usually takes 
over the role as the dominant part of the brain. In our dreams we 
live in an image-world. According to Kosslyn (1975) more details 
of a mental image of an object are remembered when the objec^ is 
imagined next to a smaller object. Thus the relative size of a part 
of an image may affect our ability to remember and recognize it. 
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Modem systems for computer-aided design makes it possible 
to actually display a similar kind of "inner images" on a screen or 
on paper with the help of a plotter before the object itself actually 
exists. It is often possible to rotate the screen image of the object 
and study it from all possible angles. It is often also possible to 
"take the object apart." 




In comic strips inner images may be used to tell the story. 



Development 

The ability of children to decipher the contents of a picture is 
governed by their mental development, previous experience and 
social circumstances. According to Piaget, chronological age is 
the most important factor in a child's mental development. He 
described four stages of that development: 

1 The sensory-motor period (0 to 2 years) 

2 The pre-operational period (2 to 6 years) 

3 The period of concrete thought processes (7 to 12 years) 

4 The period of formal or abstract though processes (from 13 
years) 

Noble (1975) analyzed the way in which children of different 
ages perceive the content of TV programs and found very wide 
differences between children in the different stages of 
development. Children from 2 to 6 tended to either strongly like 
or dislike what they saw. They had difficulty in distinguishing 
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between internal and external experiences, i.e. between 
imagination and reality, and felt involved in and able to influence 
events in TV programs. They are unable to comprehend how 
different aspects of an event may be interrelated and therefore 
view TV programs as a succession of mutually unrelated 
happenings. 

When children acquire the ability to carry out reversible 
thought processes in the third stage of their development, they 
begin to respond systematically to concrete stimuli in their 
surroundings. Their world of thought is no longer restricted to the 
present, and it becomes possible for them to foresee events and 
understand relationships. At the beginning of this stage of 
development, the children concentrate on special events in a TV 
program, but they gradually begin to understand the plot. 
Children from 11-12 are only capable of understanding the 
concrete, psychical behaviour of the TV performers, not the 
emotions supplying the motivation for a given action. From about 
the age of 13 children begin to be capable of dealing with logical 
thought processes on an abstract plane. Only at this stage do they 
acquire the ability to understand the indirect symbolism often 
found in movies and TV programs. 

Illustrations in materials for use with children under thirteen 
should be strictly relevant to the text. Younger children can not 
ignore incidental illustra-tions. If pictures do not help they will 
probably hinder the understanding of the content. 

Noble found that TV producers could accurately predict what 
children would like but not what children would understand. 

Social circumstances, in addition to chronological age and 
intelligence, play an increasingly important role in the ability of 
children to understand the events in a TV program. 

Various studies have showed that middle-class mothers talked 
and discussed things with their children to a greater extent than 
working class mothers. In Noble's view, therefore, we can 
expect to find similar differences as regards TV programs. The 
socialization process in middle-class children means that these 
children tended to receive more encouragement in understanding 
the programs. 

Troger (1963) felt that children first have to learn to 
comprehend individual pictures before they can comprehend the 
plot of a movie. A basic requirement here is that the children 
really are capable of distinguishing be_ jen an object and a 
picture of that object. Only after this is possible is a child mature 
enough to deal with various subjects on an abstract level. Troger 
suggested that children do not achieve picture comprehension un- 
til they reach the age of about six. Comprehension of movies is 
therefore only possible after this age. 



izo 



121 



Troger defined the following stages in movie comprehension: 

1 The child attains picture comprehension, i.e. the ability to 
distinguish be-tween an object and a picture of the object. 

2 The child comprehends individual scenes in a movie. But these 
scenes are not perceived as being related to prior and 
subsequent scenes. 

3 The child begins to comprehend the interrelationship of 
individual scenes. 

4 The child begins to comprehend all the relationships in the 
film. 

Troger's view are in close agreement with Piaget's and 
Noble's with the exception of age level. Actually, children 
probably attain facility in picture comprehension at a much earlier 
than six, possible as early as three years. 

In Tr6ger*s view, children under seven perceive movie reality 
differently than adults. Even here Troger described four stages of 
development which arise in chronological order but at different 
ages for different children, depending on their development in 
other respects. 

1 The child lacks movie comprehension and views a mo-vie 
reality. 

2 The child views a movie as a reproduction of reality, i.e. the 
events on the screen have really happened. The photographer 
just happened to be passing and made tlie movie. 

3 The child perceives the movie as possible reality, i.e. they 
understand that the movie was made but that the events in the 
movie could actually happen in reality. 

4 The child perceives the movie as selected and processed 
reality. Not every adults reaches this stage. 

In the United States, TV programs made for children are 
basically designed in the same way as programs for adults. In 
programs such as Sesame Street, for example, children see a 
series of rapid and varied scenes which are frequently unrelated to 
one another. The programs are chopped to pieces by commercials 
in which admonitions to buy are hammered into their heads. 
Children's programs in Sweden are better tailored to children's 
prerequisites. The Soviet Union is even more advanced in this 
respect. The state-run Soviet TV company produces programs for 
five age groups: up to the age of 7, 8-10, 11-14, 15-18 and over 
18 years of age. By now, the Eastern Bloc countries must have 
amassed considerable know how about the way TV programs 
should be designed to suit different age groups, lis. ^ever, less is 
known about this subject in the West. 
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Results indicate that visual language exists, at least for three-, 
five-, eight- and twelve-year-olds, and that this language is 
apparently more efficient than verbal language in memory tasks. 
A verbal response to visual stimuli or a visual response to verbal 
stimuli requires a transformation from one modality to another. 
Die ability to transform from verbal to visual modality develops 
more rapidly than the transformation from visual to verbal 
modality. As previously noted we may have one kind of memory 
for pictorial material and another for linguistic material Pictorial 
stimuli are stored as images and not as words. The stimuli cannot 
be recalled without extensive cognitive efforts to retrieve the 
stored image, transform it into words and then verbalize those 
words. 

Reynolds-Myers (1985) suggests that we put the theories of 
Piaget, Bloom and Gagne together to be able to meet the 
principles of visual literacy. 

Basic assumptions of Piaget*s theori: 

1 The ability to think and reason occurs in developmental stages 
through which individuals progress in an in-variant order. 

2 These stages are dependent upon several interacting factors; 
physical maturation, experience, social transmission, and 
equilibration. 

3 Although the stages develop in a fixed order, individuals move 
firom one stage to another at different ages. 

4 An individual may function in one stage for some bodies of 
knowledgev while he function in a different stage for other 
bodies of knowledge. 

Basic assumptions of Bloom and Gagne: 

1 Desired learning outcomes can be described and classifiec' mto 
level*", "^f learning. 

2 A lii^jer class of learning subsumes all lower levels of 
learning. 

3 Inseruction can be designed to allow the learner to develop the 
desired level of learning. 

However, before we can do this we must refine the means of 
testing for learning. At the present time, most learning is 
measured or assessed through verbal means. Although neither 
Gagne nor Bloom describe cognitive learning outcomes as the 
ability to verbalize aloud or in writing, the majority of the 
instructors assume that testing or assessment implies paper, 
pencils and written wordb. Learning can be assessed in a number 
of ways. 
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Illusions 

One and the same stimulus can easily be perceived in different 
ways on different cx:casions. A very famous example of this is the 
Necker cube. It is perceived in one of two ways. There are many 
examples of "transformation" pictures of this kind. Some artists 
have become specialists in making pictures which can be per- 
ceived in different ways. Victor Vasarely, M C Escher, Norman 
Ives and Malcom Grea are especially well-known. 




The Necker cube left and the two ways can perceive it. 

When the brain analyzes new data, it automatically adds or 
subtracts information in an effort o obtain a "sensible" 
interpretation of that data 




This figure is "impossible". The depth ambiguity means that the eye is unable 
to obtain all the information necessary to locate all the figure's parts. The brain 
becomes unable to determine how to interpret the image. 

WORD 

We often think we see things which are not really there. The black lines here are 
interpreted by many viewers as forming the word "word". An illiterate person 
would be unable to interpret the lines as forming a word. 
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We often have difficulty in interpreting simple relationships. For example, 
horizontal lines are often perceived as being shorter than equally long vertical 
lines. 




Open and light forms are perceived as being larger than closed and darker 
forms of the same shape. 




The left figure seems to have a longer horizontal line than the right figure. 
(Muller-Lyer*s illusion). 




The left vertical line seems to be longer than the right vertical line. (Ponzo*s 
illusion). 
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Intersecwd straight lines no longer appear to be straight but bent or serrated 
(Wundt's illusion). 




These intersected parallel lines no longer appear to be parallel. 



An intersected circle no longer appear to be a circle. 
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In regular patterns like these the areas in the intersections of the white and 
black lines look gray. The total black and, respectively white area must be 
considerably larger than the white and. respectively black area for this 
phenomenon to arise. 




Changes in scale produce an illusion of elevations or depressions in a figure. 
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Language 



According to Skinner (1957) language is a behaviour which is 
learned by habit. Children imitate adults until they learn the 
language spoken by them. Eriksson (1968) cites Chomsky (1959) 
who argued that language is not "a set of habits". Instead, the 
development of language is a continuous and creative process 
working in concert with the surrounding. The brain develops 
verbal proficiency making it possible for Man to formulate and 
understand an infinite number of sentences. This view has been 
supported by the findings of a number of scientists after 
Chomsky (e.g. Slobin, 1973, and Littlewood, 1984). 
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Twyman's (1982) language model devised to accommodate the approaches to 
language of linguistic scientists and graphic designers. Reproduced by 
permission of the author. 

According to semiotics ah cultural processes may be seen as 
communication processes (Eco, 1971). Thus, there are different 
languages, such as spoken, written, and visual languages. 
Lotman (1973) suggested that any system used as a means of 
communications between people can be regarded as a language. 
Cochran U987) concludes that humans cannot transfer ideas 
whole and intact from one person to another. Human 
communication depends upon an interactive series of successive 
approximations presented in metaphors. She finds "languaging" 
useful in directing attention to the actions of people as they share 
their own ideas, listen to others, or learn from technologically 
produced sights and sounds.There are many approaches to 
language and language classification systems. Twyman (1982) 
pointed out that while linguistic scientists distinguish between 
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spoken and written language graphic designers distinguish 
between verbal and pictorial language. From a design point of 
view written, printed or displayed 'texts or "verbal graphic 
language" are important components of visible language. 
Examples of poor design which hinder the comprehension of text 
contents are far too commonplace. 

However, if the linguistic representation (e.g. the medium 
and its content) is placed at the forefront, another approach is 
natural. In this model, linguistic differentiation is based on the 
form of the messages: words, sounds, images and other forms. 
Thus, verbal language has spoken (aural), written (visual) and 
tactile categories, audial language comprises sound effects, music 
and paralinguistic sounds (all aural), visual language has 
symbols, pictures and paralinguistic visual expressions (all 
visual) and other language is based on smell, taste, touch etc. 
This latter approach is used in this paper. 



Language model based on the form of representation. The model can be 
broken down into additional sub-categories. 

Languages differ in their ability to express concepts with 
precision and flexibility. Physics, chemistry and mathematics, for 
example, employ non-ambiguous symbol and equation 
languages. In verbal and technical descriptions, the language of 
specialists must be as unambiguous as possible. Languages such 
as these can only be understood by people with the appropriate 
specialized knowledge. Normal prose is often open to multiple 
interpretations, i.e. it is ambiguous. Fiction and poetry in par- 
ticular offer abundant opportunities for individual interpretations. 
Pictures are normally ambiguous too. 
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In the animal world various body signals supply most of the 
communications between individuals. Animals send messages by 
displaying parts of their bodies in various ways. Message 
receivers "respond" with equivalent displays or movements. Bees 
have developed an advanced "language." After returning to the 
hive, a bee can perform a dance informing other bees about e.g. 
the location of a source of food. 

Body language, paralinguistic and extralinguistic signals is 
also important in Man. Some scientists suggest that body 
language accounts for up to half, or more, of all our 
communications with others. Many movements and gestures can 
be interpreted without ambiguity in a given cultural community 
but not outside that community. In some societies, for example, 
the raising of an eyebrow, consciously or unconsciously, 
designates surprise. Or shrugging the shoulders designates 
indifference. But confusion and misunderstandings can occur 
before visitors to foreign cultures learn to understand the body 
language prevailing there. 

Our body language is partly instinctive, partly learned and 
imitative (e.g. Fast, 1971). An interesting fact is that bilingual 
persons change their body language, gestures and eyelid 
movements when they switch (spoken) languages. 

Brun (1974) gives many examples of sign languages. We can 
see examples of "formal" signs almost every day. De^ people are 
often very skilled in using their highly developed and structured 
visual verbal sign language. Other less sophisticated kinds of sign 
languages are used by e.g. umpires in sporting events, traffic 
policemen, people directing aeroplanes on the ground etc. Further 
examples are the sign languages used in making radio and 
television programs or movies* 

Thousands of alternatives are available to a sender wishing to 
transmit a rendition of some reality to receivers. Senders always 
utilize a "filter" and a quality checks before selecting one of the 
many available text and picture options. The choice is based on 
the sender's subjective opinions. She/he selects the option 
believed to be the most efficient for each purpose and each trans- 
mission situation. The selected pictures/ texts are then edited in 
one of many ways for the purpose of enhancing reception impact. 
TliUS, a selected, edited version of reality is transmitted to 
receivers. In mass communications, message reception can be 
affected in countless ways. For example, television reception may 
range from very bad to very good. Different viewers ?lso perceive 
the same text and/or image in different ways, since there are al- 
ways great inter-individual differences in percepH.on (Pettersson, 
1986b). 
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The context in which a message is seen can convey a "pre- 
understanding" of the message's contents. Pre-understanding is 
vitally important to our perception of any message. The language 
we choose to use in any given situation is in itself a device 
conveying preunderstanding to the reader/listener/ viewer. 
Message response is sometimes easy to predict. This 
predictability is often heavily exploited in movies, television and 
theatre. 

There is no unambiguous verbal or visual language. In a 
closed, homogeneous cultural group, "ordinary" pictures and 
texts probably give rise to similar interpretations and perceptions 
of a specific reality, single object, event, message or content. 
However, we do not know the magnitude of the individual 
"tolerance ranges" in which different texts and pictures generate 
reascnably identical perceptions. One representation may produce 
accurate perception of content by one person but a completely 
different perception by another person. Perception of a given 
text^mage by a random receiver in exactly the manner intended by 
the sender is extremely unlikely. However, senders do not often 
require identical perception of transmitted messages by all 
receivers. A large number of approximate interpretations may 
suffice. A well-written explanatoiy and elucidating caption can 
enhance understanding of the content. One study (Melin, 1986a) 
of student perception of texts and pictures in lexivision, (i.e. 
openings in a book where documentary and analytic pictures and 
descriptive texts interact) showed that pictures were better at 
expressing contrast and specification and that texts were better at 
expressing logical relationships such as cause and effect. Some 
lexivision presentations utilize the respective advantages of text 
and image. 



Intended 
content 




A large number of different representations, texts and/or 'pictures are always 
possible. The representations convey discrepant (R1), identical (R2) or 
acceptable {R3) perceptions (P) of the intended content . 
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Verbal languages 



Usually we understand what we are saying. We know what we 
mean. However, we can never be sure that other people perceive 
our verbal mcsages as we have intended. On the contrary people 
perceive and depict a given message in widely differing ways 
(Pettersson, 1986b). 



Spoken languages 

Many animal species are capable of communicating with the aid of 
sounds. The messages they convey often express simple 
concepts, such as hunger or repletion. These acoustic messages 
are usually sent to individual(s) of the same species. However, 
the noisy cries emitted by a jackdaw or crow to "warn" the flock 
are actually a form of "mass communication*' rather than personal 
messages. 

One of the simplest forms of communication between 
humans, the crying of an infant are to some degree specific for 
that specific Individual. Parents often quickly learn how to 
understand the meaning of different kinds of acoustically similar 
crying. They can also distinguish their own child's crying from 
the crying of other infants. After some time the child acquires 
linguistic facility enabling it to express a wide range of needs and 
emotions. 

More than 2,000 languages and countless dialects have long 
been said to exist. However, Gunnemark & Kenrick (1985) claim 
that there are probably 5,200 living languages, certainly no less 
than 4,500 and possibly as many as 6,000. Tens of thousands of 
years ago, cur ancestors were able to communicate with one 
another by means of some linguistic expressions. Over fhc 
millenia, language ultimately evolved into Man's most important 
means of expression. 

Man is the only terrestrial species to acquire a language in the 
true sense of the word. However, the ability to form concepts is 
not unique to the human brain. Primates and several lower 
animals are capable of entertaining general, picture-based 
concepts. Concepts probably form in their brains in a similar way 
as in Man's brain. Several scientists in the U.S. have succeeded 
in teaching chimpanzees to communicate by means of visual sign 
language. Chimpanzees can deal with more than 100 words and 
display linguistic creativity, i.e. they are independently able to 
form new, logical word combinations. To a certain extent, their 
language has a grammatical structure. Previous attempts to teach 
apes to learn a languag probably failed because they involved 
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efforts to teach apes to speak, despite their anatomical inability to 
produce human language sounds. 

Even very primitive societies often have advanced languages 
providing scope for great expressiveness. These languages 
sometimes contain many subde terms for concrete concepts. 

A pioneer in the field of semiotics, Ferdinand Saussure, 
divided the phonologic components of language into their 
smallest, non-meaningful parts, i.e. phonemes. Pnonemes are 
basic units of sound. When combined, they form units with 
meaning. A language's smallest meaningful grammatical unit is 
referred to as a morpheme. Morphemes are combined to form 
syntagms (Fredriksson, 1979), i.e. words, phrases, sentences 
and complete texts. Spoken and written languages are formed 
from a limited number of phonemes (usually 20-40). These 
phonemes can be inter-combined in a limited number of ways. 
We can make a distinction between individual language, i.e. 
speech, and super-individual language, i.e. the language itself. 
When we speak and write, the phonemes, morphemes and 
syntagms we use must follow one another in a pa'licula: sequence 
if our messages are to be understood. Language is consequently 
hierarchic and linear. 

The term "spoken language*' is almost always taken to mean 
direct, informal verbal language. A sender and a receiver share a 
highly interactive communications situation. This situation offers 
immediate feedback and opportunities for explanations and 
corrections. However, the situation is highly transient and 
impossible to rehear/resee. On the other hand, the spoken word in 
technical media lacks any interactive component to facilitate 
communications. However, TV does have limited, sender- 
controlled or simulated interaction. These media all lack 
immediate feed-back but are non-transient, at least in principle, 
and their messages can be played back. Speech conveyed by 
technical devices depends on the quality of the reproduction 
technology employed and even on factors such as cost. Speech 
reproduction devices often clip higher frequencies, thereby 
impairing reception conditions for the listener and conveying 
speech less adequately than direct conversation. 

This all means that the reception conditions of the spoken 
word conveyed by technical media are beginning to approach the 
reception conditions of the printed word. The sender must plan 
her/his message carefully. She/he must practice cognitive clarity 
and avoid ambiguity - both acoustically and optically. As is the 
case for the printed word, the language used by broadcast media 
for recurrent messages, such as weather forecasts, can be 
rationalized and formulized. Since computers can be taught to 
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"speak/* we run the risk of being stricken by the impoverished 
language of computer-synthesized speech. 

Dahlstedt (1979) predicted that the verbal language used in 
media would not only develop on its own terms but even exert an 
impact on the spoken language as a whole. The media probably 
do have a leveling effect on the spoken language and thereby 
contribute to the disappearance of dialects. As a result of its wide- 
ranging coverage, the language of broadcast media tends to be- 
come a national standard to a greater extent than direct 
conversation. As is the case for the written language, the language 
of broadcast media is tailored to be understood of a wide range of 
listeners/viewers with widely varying backgrounds. This 
development is bound to retard language development, since the 
use by message senders of old and familiar phraseology 
maximizes the likelihood of message comprehension by receivers. 



Written language 

Man*s ability to communicate was greatly enhanced when 
knowledge and inforniation began to be stored with the aid of 
simple pictures and, subsequently, symbolic characters a few 
thousand years ago. Pictographic languages ultimately evolved in 
different cultures. They initially depicted objects and events as 
realistically as possible. These early pictograms were drawn with 
a stick in sand or clay or on the wall of ^ cave with a piece of 
charred wood or bone* Ultimately, people began depicting 
abstract concepts, largely religious or magic in nature, using 
pictograms to represent concrete objects. Pictograms of concrete 
objects were often combined to designate some abstract concept 
or thought. The pictograms became increasingly stylized and 
evolved into simple symbols or characters. Each character was 
equivalent to one or more concepts and came to represent a word. 
The Chinese language is an example of a living pictographic 
(ideographic) language in which each character represents one or 
mere words. Other pictographic languages have developed in 
other ways. Alphabetic languages and alphabets evolved^when 
characters designating words began to be used to represent the 
initial sounds of words. 

The utilization of written languages, composed of individual 
letters, provided the bases for mass storage of knowledge and 
information and for communications between people at a great 
distance from one another in terms of both time and space. Most 
alphabetic written languages evolved from the Phoenician 
language which appeared around 1200 B.C. The wide-ranging 
sea voyages undertaken by the Phoenicians spread their language 
to many places* It reached the Greeks in 800-900 B.C. They 
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added vowels to the Phoenician alphabet, which only consisted of 
consonants, and began writing from left to right instead of right to 
left. Many languages have alphabets based on the Greek alphabet, 
including the Latin of the Romans. Latin, in turn, has given rise 
to the alphabets employed in most modem written languages in 
Western countries.They use only a few dozen characters to 
represent thousands of words and concepts. 

English is often said to contain no less than 750,000 words. 
Many languages are closely related. However, Japanese is an 
example of an interesting and extremely complicated language 
which is probably unrelated to any other tongue. Words 
borrowed from Chinese and European languages (English in 
particular) have been adapted to the Japanese phonetic system, but 
many of them remain recognizable. In Japanese many inflections 
share the same explicit significance but differ in implicit meaning, 
depending on the prevailing social and other circumstances. 

Japanese script originated in China and is highly complex.lt 
is said to comprise about 48,000 different characters, kanji, 
designating different words. Each kanji character can be written in 
three different fonts and has two or often more meanings, 
sometimes as many as 15-20. Combining different kanji 
characters can create a large number of new words and concepts. 
In elementary school, children learn the 996 most important kanji 
characters. A.bout 1,850 kanji characters are used in the basic set 
employed in daily newspapers. A few thousand more are used on 
special occasions. Few Japanese are able to read and write more 
than 10,000 kanji characters. The older generation frequently 
complains that "the schools just aren't teaching children to read 
well anymore." This might be true, but Japanese children must 
spend a lot of time and effort on learning to read and write, since 
their language is so difficult. In addition to kanji, Japanese has 
kana, a 48-character syllabic language developed in Japan. These 
characters are used in two versions, katakana and hiragana. Kana 
writing is used for various inflective elements and for tlie phonetic 
writing of e.g. borrowed words. 

There are very exact rulej on how to write different 
characters. Calligraphic beauty is juaged on the basis of the 
amount of physical and emotional effort perceived in it. As 
previously noted, kanji characters had their origin in Chinese 
characters. The latter evolved at least 3,400 years ago. The art of 
writing reached Japan during the 6th century A.D. It evolved into 
a domestic calligraphic language during the Heian period (794- 
1 192). Shodo is Japanese calligraphy executed with brush and 
ink. Interest in Japanese calligraphy has spread to many other 
countries, including Sweden. For example, an exhibition of 
calligraphy and ink paintings by the Japanese artist Ken Sato was 



146 

ErJc 145 



held at the House of Culture in Stockholm in the summer and fall 
of 1985. Ken-san described some of his feelings in the exhibition 
catalogue: "Japan's cultural heritage, with its aesthetic emphasis 
on everyday life, has had a great impact on my artistic studies and 
work. Shuichi Kata put it this way: "There must be hannony 
between human thought and Nature and a transfer of everyday life 
to art. Not art for the sake of art, but life for the sake of art." Ken- 
san concluded his presentation with the following comment: "My 
calligraphy-inspired paintings with their spontaneous brush 
strokes are a kind of personal handwriting containing poetic allu- 
sions. Ink paintings have a long tradition and demand freedom, 
rhythm and immediacy." 



A printed message 

Written or printed verbal messages basically consist of a number 
of characters such as those used here, i.e. a mixture of letters, 
spaces, punctuation marks and sometimes even nunicrals. Most 
letters are lower case, but upper case letters occur from time to 
time. 

aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaAAbbbbbbbbbcccccddddddddd 

dddddeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeef 

ffffffffffffffggggg^^^^^ 

hhiiiiiiiiiiiiiiiiiiiiiiiiiiiiilddkliUU^ 

nnnnnnnnnnnnnnnooooooocKXXX>oooooooooooooooooooooooo 
pppppppppq m u 1 1 1 1 1 1 i a in rni rrr sssssssssssssssssss tttttttttttttttttttt 
tttttttttttttttttttttttttuuuuuvvwwwwwwxxxxyyy-,,,,,,, 

The 428 characters above can be combined in many different 
ways. Hem is one ... 

ta eb ni si oN fo fo fo ores tao tuo, adn rae are. acn orf tis Ige eth 
hTe thp topo ckba byced. bgtod esey infef fomr fnn frae,om 
fmaom eh htad heiad caflt, Isreft ie-hft lirine pdoa^c rehst ene 
seoen sch thateil tha '^1 thsatan tahia, wieng an,ogle btlt apck 
heotuse otgther. rgihht right tmrin iiiagflht ^'eioa ,;hse htitwe 
inws. v'Aings dgea tasil eexpt muar mbtin fortked aebotve 
halves, ng her little strAong upfper. boaymote toncm botltom 
execept lihdig oliqe iaonl dinal oards, exwtea wnding peog 
erigorst edshaed 

... not very successful example. It looks like a genuine text, but 
no combination of caracters represents any intelligible concept. 
There are much better ways of combining the caracters in the 
original example. These characters can ea5,51y be used to form 
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both short and lonf words. Here is an example with more than 
one hundred real words of successively increasing length. 

a a a a A A an as at be in is is No of of of or so to to and are are 
can for its leg the the the the the the the the the The The The top 
top back body body eyes fine form form from from from from 
head head left left left line part rest seen seen such tail tail tail than 
thin wing angle black house other right right flight house white 
wings wings detail except martin martin forked above halves 
higher little strong upper bottom bottom except gliding oblique 
diagonal diagonal towards extending posterior wedgeshaped- 
>>>>>>>•••••• 

These words can, in turn, be combined to form meaningful 
sentences. 

A house martin in flight A house 'laartin seen at an oblique angle 
from above are gliding so its body form a diagonal from top left 
to bottom right The wings form a strong diagonal from bottom 
left to top right The tail is a little higher than the head The 
wedgeshaped wings the v.pper halves of the head back and the 
forked tail are black The rest of the body is white except for a thin 
line extending from the tail towards the posterior part of the left 
wing No other fine detail such as eyes or leg can be seen - 
>>>>>>> 

The addition of punctuation marks at appropriate points make 
the text much more cohesive. 

A house martin in flight 

A house martin, seen at an oblique angle from above, are gliding 
so its body form a diagonal from top left to bottom right. The 
wings form a strong diagonal from bottom left to top right. The 
tail is a little higher than the head. The wedge-shaped wings, the 
upper halves of the head, back and the forked tail are black. The 
rest of the body is white, except for a thin line extending from the 
tail towards the posterior part of the left wing. No other fine 
de^tail, such as eyes or leg, can be seen. 

Many other words could be formed and the new words 
arrayed in sentences and texts with completely different 
meanings. It is easy to conclude that a text retains its content even 
when type size is changed. Here are several examples of the 
same text in different sizes (character size is designated in 
typographical pomts -p). 



A house njaitin in flight (9 p) 
A house martin in flight (10 p) 
A house manin in flight (12 p) 

A house maitin in uight (14 p) 

A house martin in flight (18 p) 

Individual characters can be designed in many different 
ways. Here are a few examples of the same text rendered with 
different fonts. 

A house martin in flight (Times 12 p) 
A house martin in flight (Helvetica 12 p) 
A house martin in flight (Geneva 12 p) 
A house martin in flight (New York 12 p) 
fl house martin in flight (Chicago 12 p) 

Each type font is usually available in different versions. Here 
are ^ome examples of the same text with different versions of the 
same font. 

A house martin in flight (12 p,normal) 

A house niartin in jlight (12 p, italic) 

A house martin in flight (12 p, bold) 

A house martin in flight (12 p, bold, italic) 

A house martin in flight (12 p, outline) 

So type size, fonts and font versions can be combined in 
very many ways. However, these options should normally be 
used sparingly and only a few different versions utilized in a text. 
Verbal characters also retain their meaning even if rotated in dif- 
ferent directions or even turned upside down as in this example. 

V ponae ujsmu lu il!9p{ 

A mirror-reversed text (written from right to left, below) can also 
be read. 



triQilt ni nitiBm sauori A 

So the contents of a verbal message are relatively independent 
of its form. However, its readability is strongly influenc^ by its 
design or topology. The basic rule is quite simple that the most 
common type sizes are easier to read than uncommon sizes. The 
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combinations employed most frequently in newspapers and 
books have the greatest readability. Characters may obviously 
neither be too small, nor too large. In the first case we can not 
read them. !n the other case we can.only hrve a few words on 
each line, A line should not contain more than about 40 
characters (inch, spaces) if it is to be easily read. There should 
not be more than about 50 characters a line. Aspects such as 
margin width, the number of paragraphs, number of columns, 
the number of lines per page and the line width are also 
important to our ability to read text. 



Characteristics of verbal languages 

• Verbal languages have digital coding using combinations of 
letters (and/or numerals) to represent content (Elkind, 1975), 

• There is no direct correspondence between groups of letters, 
words, and reality. Each meaning is defined and must be 
learned (Elkind, 1975). 

• The properties of letters are limited, A letter has a given 
position in an alphabet, it has a name, it is represented by one 
or more sounds and is used in a context (Elkind, 1975), The 
way letters are written is of minor importance (Pettersson, 
1983a,) 

• Verbal languages have varying levels of meaning (Eco, 197 1) 

- phonemes (without meaning) 

- morphemes (with meaning) 

- syntagms, sub-meanings 

- complete meanings 

• Semantic codes, grammar and syntax must be defined (exactly) 
(Chomsky, 1959). 

• The perception of linear representations requires slow, 
sequential, processing for comprehension of content (Perfetti, 
1977, Sinatra, 1986). 

• Memory retrieval is a serial integration process and entails 
sequential processing by auditory-motor per-ception systems 
(Sinatra, 1986). 

• Perception of a text is relative. Different people perceive and 
depict a given text in widely differing ways (Pettersson, 
1986b), 

• Dissatisfaction with the execution of a message may cause 
dissatisfaction with the content of the message. 

• Perception of verbal content is apparently easier when a text is 
read than heard. Thus it is easier to assimilate and profit from a 
rich language by reading than by listening (Petters.son, 1986b). 
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A written text can convey information, contain analyses and 

describe feelings and facts (Melin, 1986a). 

Verbal depiction of the content and execution of even simple 

pictures requires relatively long descriptions (Pettersson, 

1986b). 

The more abstract a word is the harder it is to relate it to any 
specific activity (Melin, 1986a). 

People usually have no difficulty in reading the jargon used in 
professional or technical languages but understanding the 
concepts the words represent may be difficult for a non- 
specialist (Melin, 1986b). 
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Visual languages 



It has probably always been natural for man to express himself by 
means of visual messages. Since the beginning of mankind we 
have been using body languages and different kinds of signs for 
communication. 

Prehistoric Man made murals and rock inscriptions with 
mythological meaning. In everyday life, people probably made 
drawings on the ground to show the location of game etc. 
Simplified images ultimately evolved into characters, letters and 
numerals. 

Pictures helped Man communicate long before we had written 
languages for our messages. Our children make pictures, they 
draw and paint long before they leam to read and write. 

For 20,000 years we have had murals. For about 2,500 years 
we have had rock inscriptions. For about 700 years we have had 
framed paintings and put them on our walls as pieces of art. For 
more than 500 years we have had printed illustrations in books. 
\Ve have had photos for 150 years, films for 80 years, electronic 
pictures for more than 40 years and computer images for more 
than ten years. Electronic "live-pictures" last only for one twen- 
tyfifth of a second, but they can be stored for example on 
videotape or videodisc. 

Nowadays, pictures are to be found almost everywhere. They 
differ in character. It is not possible for every one to stand out on 
every occasion. People "drown" in a flood of general "pictorial 
noise", a kind of mental pollution of the environment. Visuals can 
be classified according to several different criteria such as sender, 
receiver, content, execution, format and context and even 
according to criteria such as function, use and the means of 
production etc. Thus, there are many possibilities for 
classification. However, one and the same visual can and will be 
classified in different ways at the same time depending on the 
criteria applied in each case. Often the boundaries between 
different groups partially overlap each other. 



Functions 

From a theoretical point of view, a visual can possess many 
different functions and effects or combinations of functions and 
effects. Thus, a distinction can be made between symbols and 
pictures . 

In western civilizations a symbol is usually something which 
"represent" something (Lee, 1959). We "apply" words to things 
or names to persons. These "signs" stand for the things to which 
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they have been applied. However Agrawal et. al. (1987) points 
out that in the context of the ancient Indian civilization the symbol 
is not a representation. A symbol is a concretisation of reality 
having intrinsic power of its own. It is a part within the whole 
belief system, and a link between the past, the present ana :he 
future. 

Signposts, traffic signs and labels are examples of symbols. 
They are unambiguous by convention. We agree and decide on 
their meaning. 

All pictures are representations of reality and depict the 
physical structure of the objects they represent. As is the case for 
other kinds of representations, pictures are always open to 
different interpretations by different people at different times. 
Some pictures are open to many interpretations, others to only a 
few. Cochran (1987) distinguish between actual events/objects, 
iconic re-presentations and arbitrary representations. Examples of 
iconic re-presentations are film and TV-images, still photographic 
pictures and realistic art work. Symbols, signs, computer 
graphics and words are all examples of arbitrary representations. 
Here no cues from actuality are left. 

"Pictures" may be classified as realistic, suggestive and 
schematic. "Realistic" pictures can provide reasonably objective 
documentation of a situation, product or course of events. Photos 
and movies. X-ray films, satellite photographs, thermographic 
pictures, ultrasonograms and certain documentary drawings are 
examples of "realistic" pictures. "Suggestive" pictures also cover 
a wide field. A picture in this category can serve to express the 
picture creator's particular circumstances and convey messages 
about this person's internal or external reality. Examples of 
"schematic" pictures are various kinds of maps, charts, graphs, 
engineering drawings, EEG and ECG recordings etc. 

Pictures can attract attention to and create interest in a given 
material or in a given subject. 

Pictures may be cognitive and convey knowledge and 
information to the reader or viewer. They can facilitate learning 
from a text by enhancing comprehension and memory. Pictures 
can be used e.g. for instructing, exemplifying, identifying or 
providing variation, authority or information as a supplement to 
text and sound. Pictures are often used for content that is 
important, hard to understand and new. 

It should be remembered that pictures can have a negative 
effect. The inability of children younger than thirteen to ignore 
incidental images means that effects are unlikely to be neutral: if 
the pictures do not help, they will probably hinder. Illustrations 
should be strictly relevant to the text. 
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Pictures can be affective and provide readers with 
entertainment and reinforce an experience. They can trigger 
associations and influence emotions and attitudes, especially in 
movies and TV. In advertising and television pictures often carry 
subliminal messages. Ads for liquor for example sometimes use 
sexual symbols. 

Pictures can be compensatory, making it easier for poor 
readers to comprehend, learn and recall things they read in a text. 

In various ways, pictures often have important social 
functions In the home, at school, in organizations and in society. 
Picture creation is more important than the visual results in certain 
instances. Some pictures may not have any or only a limited 
function once created. Modem cameras which automatically set 
the exposure, focus the lens and advance the film have made it 
possible for anyone to take pictures. More than 90% of all 
Swedish families own at least one camera. Two thirds of the 
population make a movie or take still photographs at some time 
during any year. Millions of amateur photographs are the result. 
The advent of lightweight, portable VCR equipment has opened 
up new horizons for non-professional creators of moving 
pictures. 

Pictures may also have a generally decorative effect and be 
used to improve our environment. 

Results from several experiments show that learning is 
facilitated and maximized when visual, audio and print media 
contain the same information. In normal situations, the addition of 
visual embellishments has not been found to enhance the learning 
of information which is only conveyed in printed form. The 
presence of text-redundant visuals will neither help nor hinder the 
learning of information given in the part of the text without 
illustrations. Some picture editors admit that some of the pictures 
they use in textbooks are only there to to "stimulate" the reader, to 
have "a life of their own" or merely to provide a "breathing space" 
within the text. This seems doubtful. Many illustration (often 
without legends) in contemporary textbooks appear to serve no 
useful purpose whatever. It is even possible that certain types of 
illustrations, incorporatftd to "stimulate" the reader's imagination 
and interest, could instead have a heavily governing effect which 
stifles the imagination and diverts interest from the information 
and knowledge the author wishes to convey. 

In the selection of visuals for reference books and textbooks, 
picture editors often ask themselves questions such as the 
following: 

• Does the picture depict the right thing? 

• Is the presentation of the subject satisfactory? 

• Is the picture technically acceptable? 
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• Is the picture aesthetically satisfactory? 

• Is the picture "flexible," i.e. will it work with different 
formats? 

> Will the picture fit into a given area? 

• Will the picture fit in with the other pictures on the same page? 

In practice, many picture editors find that procurement time, 
availability and image clarity are the most important 
considerations in making actual choices among visuals. A number 
of puthors have described different methods for the editing of 
visuals so as to change their importance and impact. Some 
important changes which can be made to a visual prior to 
publication should be mentioned. For example, a picture editor 
may elect to crop or expand the original picture. Parts of the 
picture can be deleted, added, altered, moved or changed in 
shape. The picture can also be enlarged or reduced. A color can 
be changed, removed or added. The picture's expressiveness can 
be altered by the choice of repro method etc. 

Visuals cost money, often quite a lot of money. But in many 
situations a "good" picture need not cost more than a "bad" 
picture! Spending a lot of time on the visualization process and on 
sketches (usually a less expensive process than the cost of 
originals, "masters" and printing runs) may therefore be 
worthwhile. When material is going to be used in another culture, 
extreme care must be used in preparing the illustrations. 

Levels of meaning 

Everyone appreciates the need to learn the meaning of words and 
that words and texts are things you have to learn. However, we 
also have to learn to "read" and understand the meaning of visual 
information and the components of visual language. The learned 
ability to interpret visual messages accurately and also to create 
such messages is visual literacy. interpretation and creation 
in visual literacy can be said to parallel reading and writing in 
print literacy. Visual languages differ just as spoken and written 
languages differ. The codes used in visual language differ in 
different cultures as well as in many sub-cultures. Even within a 
western mass-media country like the U.S., visual codes differ in 
different parts of the country, in different socio-economic groups 
etc. Visual languages have their own "grammars", syntaxes etc., 
just like spoken and written languages. To a limitec extent, some 
of the factors involved in the grammar and syntax of visual 
languages are kno vn. However, most of this linguistic work still 
remains to be done. One obvious problem is the lack of simple 
and general systems for classifying visual messages. 
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Reynolds-Myers (1985) postulated the following "Principles 
of visual literacy theory". 

• Visual languaging abilities develop prior to, and serve as the 
foundation for, verbal language development. 

• Development of visual languaging abilities is dependent upon 
learner interaction with objects, images, and body language. 

• The level of visual language development is dependent upon 
the richness and diversity of the objects, images, and body 
language with which the learner interacts and upon the degree 
of interaction. 

• The level of visual language development is facilitated by direct 
learner involvement in the process and equipment used to 
create objects, visual images, and body language. 



In a printed text a=a. The execution of the letters usually does not affect their 
meaning and content. 

In contrast to spoken and written languages pictures have no 
general, distinguishing elements which are not bearers of 
information. Visual languages have analog coding. Visuals are 
iconic. They normally resemble the thing they represent. The 
simplest components in a picture, i.e. its basic elements, are dots, 
lines and areas which can be variexl in a great many ways. A dot 
may vary in size, shape, color, value, grain, position and context. 
A line may be varied with respect to its starting point, length, 
direction, curvature, shape, thickness, evenness, points of 
changes, printing, color, value, grain, brightness, orientation, 
terminus and context. An area can be varied with respect to size, 
"emptiness," shape, color, value, grain, texture, shaded, non- 
shaded, gray scale, color combinations, brightness and context. 
Three dimensional pictures also possess volume in different 
forms. Basic graphical elements are sometimes meaningful, 
sometimes not. The number of ways in which the smallest im ge 
components can be inter-combined is unlimited, and the 
importance of certain combinations varies from one picture creator 
to another. 
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So basic picture components are not equivalent to the 
phonemes in spoken and written languages. If there were some 
kind of "visual phonemes," it would be possible for people to 
learn to draw and paint in about the same way they learn to read a 
text. In a picture, the basic image components - dots, lines and 
areas - form shapes which form visual syntagms or sub- 
meanings. These components interact to form complete meanings 
in stills, picture series or moving pictures. 
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However in a pictorial presentation, a dot or a line may have widely varying 
meanings. Here, execution influences content. To illustrate this, six copies 
were made of a simple drawing. Figure 1 was left unchanged. The mouth was 
changed in figures 2 - 5 by the addition of small lines which completely altered 
our perception of the illustrations. In Figure 6 a small line was added to the hair, 
but this addition has no effect on our perception of the illustration. 

In visual language, a small dot is usually a meaningless or 
non-significant image element, su^a as one of many halftone 
dots, but it could also be a syntagm, such as an eye in a cartoon- 
face Or it may even have a complete meaning, such as a ball in 
midair. It all depends on the situation depicted. So like written 
and spoken languages, visual language has numerous but varying 
levels of meaning. The following levels can be listed in an 
ascending order of complexity: 

1 Basic elements, dots, lines, areas and volumes (non- 
significant) 

2 Shapes (uov -significant) 

3 Syntagms, sub-meanings 

4 Complete meanings 

a) Stills 

b) Picture series, such as comic strips 

c) Lexivisions 

d) Moving picture depictions, such as TV programs. 

Dots, lines and areas can be put together in many ways 
resulting, Li different contents. Changes of the basic elements will 
result in different images sometimes of great and sometimes of 
minor importance. 
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Non-significant basic elements (dots, lines and areas) are arrayed into shapes 
which lorm syntagms or sub-meanings (here an eya.) 




The syntagm eye can be a part of the complete meaning face, which in turn can 
be a syntagm in other complete meanings. This specific face may be a part of 
pictures of jacks as well as kings in all suits. Here the complete meaning is 
specified by Ihe symbols for suits and numeric values. 



Here is another example with eight black areas. 
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These areas can be combined in many different ways. Here is 
one example ... 




... not particularly successful. No combination of characters 
corresponds to any intelligible concept. The picture gets no 
concrete image content. There are better ways of combining the 
characters in the original set. In tlie following example the 
elements are combined to form a bird, a house martin in flight. 




Simple image elements, such as those used to depict this 
house-martin, can be rotated, turned upside down and re- 
combined to form a series of completely different but still 
intelligible representations of real concepts. On the next page are 
two such examples. 
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Contrary to the situation with verbal messages the contents of a 
visual message are highly dependent on its shape. Size variations 
for example are only possible within certain limits. The image 
can be made rather small ... 

>^ 

... or rather large, but will then not convey the same message. 
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There is an optimum size for every pictorial subject. This size 
can only be established by trial and error. In this instance, the 
small version is probably too small and the large version 
needlessly large. 

If two different sized pictures of objects such as house- 
martins are placed next to one another, one is perceived to be 
near the viewer and one farther away. Or the birds are perceived 
as being of different sizes. Maybe one bird is aduit and the other 
still a baby bird Or maybe the two birds belong to different 
species. 

Visual signs do not retain tiieir meaning in the same way as 
verbal signs when rotated and turned in different direction. Turn 
the page in different directions and see in what way the impact of 
the pictures change. Also the actual placement on the page, the 
layout, is important. 



This is an "upside-down" mirror imap- Here the house- 
martin is ascending to the right and not descending to the right as 
in most of the prewious pictures. This picture supply the viewer 
with the same basic information about the bird's appearance but 
completely different information about the bird's actions. 
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In this "side-ways"mirror image the house-martin is 
apparently descending to the left. Again the image contains the 
same basic information as the original image about the bird's 
appearance but completely different information about the bird's 
actions. 

However, Cossette (1982) claims that it is possible to build 
an iconic "alphabet". He identified six families of basic graphic 
sign elements, which he called graphemes, e.g. "visual 
phonemes". Each of these graphemic elements is part of one of 
six continuum families: tallness, value, grain, color, orientation 
and form . The same variables were discussed by Berlin as early 
as 1967. Each grapheme signifies nothing in itself. A spot is 
nothing but a spot. Together with other graphemes the spot may 
be contextually enriched to a unit of iconic significance, an 
iconeme. In a photograph of a man one iconeme can be an arm, a 
leg, the head and so on. By analysis of an image it is possible to 
identify the iconemes which are important to the information 
content and identify the key syntagm, the "meaning nucleus" of 
the visual. By editing, eliminating or adding certain iconemes the 
effectiveness of an image can be altered. 

In my view, the Cossette graphemes represents qualities more 
than visual phonemes. Graphemes would instead be dots, lines 
and areas, since they all can vary more or less with respect to 
tallness, value, grain, color, orientation and form. Anyhow they 
are all variables in the visual language. 



Structure 

The structure of visual language is formed by different image 
variables which jointly influence our interpretation of images. 
Image variables can be subdivided into four main categories: 
content, graphic execution, context dind format, 

......;n 

o 



Content Execution Context Format 

Variables in visual language can be related to content, execution, context and 
format. 
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Variables related to image content are the degree of realism, 
the amount of detail, objects, time, place, space, events such as 
"action," humour, drama, violence etc., time displacement, 
parallel action, metaphoric descriptions (symbolic actions), the 
relevance and credibility of the contents, comparisons and 
statistics, motion, sounds such as speech, music, sound effects, 
and emotions. Some of these variables apply to moving pictures 
in films or TV. Some --pply to stills in printed media like books, 
newspapers etc. Others apply to both stills and moving pictures. 
The contents of pictures can evoke highly positive or negative 
responses in viewers, especially in children. Visual language can 
affect our attitudes and emotions more easily than speech and text. 

Variables related to an image's "graphic execution" or art 
style may consist of image factors and image components. They 
are composed of non-significant image elements, such as dots, 
lines and areas in different combinations. 

Examples of image factors and image components are image 
type, i.e. whether images are drawings, paintings, photos, 
computer-generated visuals etc., brightness, light, shape (external 
shape, external contour), size (image, subject, depth), color 
(color, hue, gray scale), contrast, emphcsis, composition 
(organization, centers of interest, balance), perspective (depth, 
depth -of- field, image angle, image height), technical quality, 
symbols, signs and code signals in the image, pace, speed change 
(slow, fast), editing, zooms in and out, panning, visual 
complexity and visual effects. 

A picture has both an internal and an external context. I 
regard factors inside the medium as "internal context." In books 
internal context is the interplay between text and illustrations, the 
interplay between illustrations, and layout. Movies and TV 
programs have sound with speech, music and sound effects plus 
visual and audio metaphors. Some computer programs contain 
ac.vanced animation with interaction between text, images and 
even sound. I regard the entire communications situation, i.e. 
senders and their intentions for the picture and receivers and their 
circumstances (e.g. time available), as external context. 

The choice of "format" is of major importance to our 
perception of image contents. Our perception of a picture (such as 
a photograph) changes when we view it as a paper print, 
transparency projected on a white screen, as a computer image 
etc. If you watch a film on TV, cable TV or VCR at home alone, 
your perception of the film is very different from your response 
when you watch the same film on a wide screen with hi-fi sound 
in a cinema full of people. In analogical technical systems, letters 
and numerals are represented by defined "type" (a, b, c...). Pic- 
tures consist of lines and halftone dots. In digital systems, image 




elements are mathematically defined either as intersections of co- 
ordinates and vectors providing direction or as "pixels," i.e. small 
rectangular image components. 

As an example of the interplay between different variables, 
let us consider an ordinary deck of cards. It consists in fact of 
fifty-two (or fift> four) different visuals. Regardless of the suit, 
cards with small values, such as one to six are usually "very easy 
to read." It only takes one or a few glances for a card player to 
know which one of the fifty-two cards he has been dealt. Cards 
with values from seven to thirteen contain more information and 
can be classified as "easy to read." However, pictures of jacks, 
queens and kings are sometimes harder to read and distinguish 
from one another, depending on their design and execution 
complexity. 

Cards of the same numeric value, e.g. four, differ in their 
execution with respect to the symbols for the four suits. Thus, 
they differ in content. 

Different decks of cards can differ in design and execution. 
Thus e.g. the king of spades looks different in different decks but 
the king always represent the same content. A card seen together 
with other cards is seen in different contexts. Thus, the value of 
one card (or of any other visual) is different for the player (or for 
the user) in different contexts. 



Ratings of variables 

In a study of picture readability (Pettersson, 1983.1), 15 expe- 
rienced "visual design experts" in Sweden were asked to rate the 
importance of each of 21 individual visual language factors to the 
total readability of a picture. They indicated their ratings on a 
questionnaire with a semantic scale from "very slight importance" 
to "very great importance". The results suggest that it is very dif- 
ficult to rank the variables. Only a few of the variables were re- 
garded as being of very slight or very great importance. A 
number of respondents noted that in their view the variables 
varied in importance depending on the context. Thus a variable 
may be very important in one context but of only slight 
importance in another. 

The same task were later given to 25 students in the USA. 
Also the results from this rating suggest that it is difficult to rank 
the variables and that the variables vary in importance. In these 
model experiments the number of subjects were limited. In an 
attempt to get more information copies of a somewhat extended 
and partly different questionnaire were sent to members of IVLA, 
International Visual Literacy Association, who distribuied them 
among their students. In this case a semantic differential scale 
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which combined verbal statements with numeric values (0-100) 
were used. This scale has been successfully used in several 
studies (e.g. Pettersson et.al*, 1984). The use of numeric values 
makes it possible to calculate mean values. 

The idea was to collect information from several different 
cultures and compare the results. Questionnaires were sent back 
from Canada, Holland, Japan, United Kingdom, United States, 
Sweden and Switzerland. An analysis of more than one hundred 
answers show enormous variations between individual subjects. 
For most of the 24 variables there is a difference of 70-80 points 
with mean values rartging from 58 to 76, corresponding to "great 
importance". Standard deviations were also very high (15-22), 

In this study it is not possible to find any certain differences 
between the opinions of subjects in different countries. Basically 
the study support earlier findings and show that people have very 
different ideas about the importance of various aspects of visual 
language to the readability of a picture. However, on average all 
variables axe "important". Several subjects also noted that vari- 
ables varied in importance depending on the content and the 
context. A few subjects noted that it was very hard to isolate and 
rate the importance of individual variables since they all interact in 
forming the visual message. 

Future research in this field will probably have to use sets of 
actual test pictures for people to react on. These test pictures will 
probably be judged differently by individual subjects. However, 
there might also be cultural differences. 



Properties 

Spoken and written languages, like text and music, are linear. 
They must be read (listened to ) in a particular sequence to be 
comprehended. However, visual language is two-, three- or four- 
dimensional and can be "read" by letting the eye scan a picture or 
sculpture in many different ways. Time is an important 
dimension, not only in film and TV, but also in still pictures. Our 
"decoding" of an image, and our subsequent perception of it, may 
vary considerably with respect to which of the visual cues we see 
first. Studies of eye movements h£./e shown that we often scan 
pictures in search of simple shapes providing structural 
simplicity. Missing information is filled in by the brain so a 
logical and "complete" visual impression is created. Influenced by 
our reading habits, people in western countries often scan pictures 
from left to right. 

In comparison to a written text, a visual contains an infinite 
amount of information (Pettersson, 1985). By selecting and 
utilizing different parts of a picture's information on different 
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occasions, we can experience completely new and different 
perceptions when we re-see a picture in new contexts. Like other 
languages, pictures consist of coded messages which are 
comprehensible in a given social context and in a given age. For 
example, we often find it difficult to interpret the messages in 
pictures from unfamiliar cultures and ages. "Modem art" puzzles 
its public who have not yet learned to decipher the new codes. 
The reader (viewer) always has greater freedom in interpreting a 
visual message than a verbal message. Pictures almost always 
convey multiple messages. Extraneous messages may compete 
with the messages the sender regards as significant and important. 
So pictures always incorporate some ambiguity and numerous 
"correct" interpretations, although not always a picture creator*s 
intended or anticipated interpretation. The way in which a picture 
is interpreted depends to a great extent on the reader^s code in 
relation to the sender^s code. Studies of intended vs. perceived 
image content give clear evidence that there are major differences 
between intended and perceived image content. 

There are many ways to depict even the simplest object. 
Many pictures are appropriate to and representative of a given 
designation, such as "Easter," "Christmas," and "flowers," 
"children," "horses," "dogs," "cats," "cards" etc. The depiction 
of e.g. "Jesus Christ" and "Buddha" is commonplace in the 
classical art of the respective religions. The number of pictures 
capable of depicting a concept declines as the degree of 
descriptive detail increases. Many pictures may be regarded as 
"visual synonyms." A message may always be expressed in 
different pictures. A picture will always be interpreted in diff.^rent 
ways Thus it may be concluded that pictures used in instruct.onal 
materials always should have captions to guide understanding of 
the content. 
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An intended content can be expressed using many different pictures. A verbal 
description of a picture is perceived in many different ways (p 1-8) and can be 
applied to many different pictures (picture 1-8). 

As far as ambiguous pictures are concerned, there is often a 
major difference between their denotation, i.e. their literal 
meaning, and their various connotations, i.e. their associative 
meanings, and their private associations . 




Each complete meaning can be interpreted in different ways b> various 
persons. We can define fields of denotation, connotation and private 
associations. 

By e.g. exaggerating perspective, deforming shapes, making 
symbolic use of colors etc., a picture creator can easily create 
works which evoke extra associations in viewers. This is in fact 
the very idea behind an artistic picture. However, the informative 
picture should not be open to different interpretations. The 



picture's message should then be the message intended by the 
person/agency commissioning the picture. 

The total amount of information presented varies very 
considerably in different media. / typed A4-sized page can hold 
up to 2,500 characters, whereas a TV image consists of 250,000 
pixels whose color content and gray scale can be changed 25 
times a second. 3y editing a text we can reduce the number of 
words required to convey a "content." The amount of information 
in synthesized (computer-generated) speech can sometimes be 
vjr uy » /o wiiiiuui Ouxiierauon or message compre- 
hension. A number of graphic elements in pictures can also be 
reduced without any major impact on content. We can delete, add 
or relocate information. Graphic elements which constitute 
boundaries between different image elements are more important 
to our perception of the image than other graphic elements. In 
principle, it should be possible to delete a ratXier large number of 
non-significant elements in e.g. a photograph. As long as some of 
the significant picture elements are retained, we can still get some 
idea of the image content. So image design can be changed a great 
deal without any major change in the perception of image content. 




Image design can be changed a great deal without any major change in the 
perception of image contenL In this example one hundred pixels was 
successively changed. 

Since the brain fills in missing information and, in certain 
instances, attempts to make the best possible interpretation of a 
given stimulus, certain significant graphic elements can also be 
deleted from images. Missing lines in cartoons can sometimes be 
as important as the line*? actually used. Employing about the right 
amount of graphic elements and finding the right visual balance 
are characterisrics of skilled and experienced artists, 
photographers and graphic designers. Inader^uate information 
results in an inadequate picture. Excessive information results in 
visual overload making a picture hard to interpret. There is an 
optimum trade-off for e .ch content and application. 
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^ The graphic execution of a visual can be measured by 
objective as well as by subjective methods. The content can only 
be measured by subjective means. Each content has an execution, 
and each execution has a content. The variables in visual language 
have both functional and suggestive properties. Functional 
properties are related to cognitive factual information in contents, 
execution and context. Suggestive properties are related to 
emotions, conceptions, aesthetic perception, tension, fright etc. 
The choice of format also comprises a large measure of emotional 
content. 



^ i number of meanings 




A symbol (a) usually has only a denotation and very few connotations and 
private associations. It is unambiguous. All other visuals have one or more 
connotations and private associations. They are more or less ambiguous. In 
realistic pictures (b), used in instructional message design, functional 
properties are more important than suggistive properties. In a suggestive pic- 
ture (c). like a painting, the reverse is true, (f = functional properties and s = 
suggestive properties). 

Functional properties predominate in symbols.They are also 
more important than suggestive properties in "informative," 
"information-dissemination" or "educational" pictures, since their 
task is to convey certain knowledge, information etc. in the 
simplest and most effective manner possible. 

The objective of a "information-dissemination" picture . also 
to convey certain emotions and arouse the viewer's interest and 
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involvement (e.g. regarding conditions in other countries or in 
past times.) 

Suggestive properties are more important than functional 
properties in "artistic" pictures. Art is not primarily a question of 
objects. It is actually a visual language for dissemination of ideas 
and experiences which are difficult to put across in words. 
Irrespective of the sender's intentions, different receivers may 
respond in an emotional manner to a picture with mainly func- 
tional properties. In the corresponding manner, some viewers 
may respond unemotionally and functionally to pictures with 
predominantly suggestive properties. 



r 




Examples of visual synonyms, three queens from different decks of cards. The 
variation between the different decl'.s may be greater than the differences 
between cards of different values in the same deck, with the exception of the 
symbols. In several cases it is only the symbols that are differentiating between 
individual cards. In some cases the symbols of the suit may be integrated m the 
design Ci the figure. 

Picture readability 

All sighted people are capable of "looking at" a picture. But 
people can also learn to "read" pictures the same way they learn to 
read words. The language of pictures used in all media should be 
tailored to reader perceptions. For example, the degree of reading 
difficulty should gradually increase in textbooks intended for 
different school grades. It is reasonable to assume the following 
as regards pictures designed to convey informstion and 
knowledge: 

• A picture that is easy to read and comprehend conveys 
information more readily than a picture that is hard to read and 
comprehend. 
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• A picture that evokes a positive response conveys information 
more effectively than a picture that evokes a negative response 
when motivation is identical in both instances. 

• Even a "poor" picture will work when viewer motivation is 
high but a "good" picture would then work even better. 

An easily read picture can be assumed to have greater 
communicative impact than a hard-to-read picture. What makes a 
picture easy to read? 

In view of our understanding of the importance of the way a 
picture is executed with respect to different variables in the vi jual 
language, the author has devised a proposal for a measure of a 
picture's readability, i.e. a picture readability index (Pettersson, 
1984). (BLIX, an acronym for this term in^ Swedish). BLIX 
values may range from 0, i.e. a virtually incomprehensible 
picture, to 5, i.e. a very comprehensible picture, and was initially 
calculated on the basis of the rating of up to 19 variables, that 
researchers had found being important for instructional message 
design. When the research started in 1979, 17 variables were 
direcriy connected to the content and execution of the visual and 2 
to the context.The 17 variables were: 1. external shape, 2. 
external contour, 3. size, 4. cc'or versus black and white, 5. 
color intensity, 6.contrast, 7. gray scale and darkness-lightness, 
8. degree of realism, 9. number of details, 10 number of centres 
of interest. 11. location of centre of interest, 12. presence of 
symbols and reading aids, 13. perspective, 14. illusions, 15. 
subject common or uncommon, 16. size of main subject and 17. 
technical quality. The remaining 2 variables were: 18. legend, and 
19. relationship between legend and picture. 

The BLIX-test was constructed in such a way that all kinds of 
pictures could be Indexed. Relations between different pictures or 
layout was not taken into account here. Experiments with ranking 
and rating of test-pictures showed that pictures with high BLIX- 
values were ranked and rated better than those with lower values 
by children as well as by adults. 
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mle har impHcil llllgdng till 
explicit futura' klarvoajans 
betraffande kombinations- 
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Two of the six versions of the picture "a blue titmouse perched on a branch". 
The intended BLIX ratings are 5 (left) and 2 (right). Here the visuals are very 
much reduced and not in color. 

Experiments with the actual making of pictures showed that 
despite detailed instructions cri the execution of the visuals there 
was still plenty of scope for individual creativity. It was also 
shown that informative pictures drawn so tnat their BLDC-ratings 
were high (more than 4,5) a, were to a large extent rated as a 
aesthetically pleasing, b, rated as "suitable" or "very suitable" for 
teaching, and c, did not take more time to make than pictures with 
lower BLIX-ratings. 

As expected, analysis of the importance of different variables 
showed that adults had a better grasp of pictuio variables than 
children. 

Adults are therefore, naturally, better equipped than children 
to understand visual language. These analyses gave as a result a 
revised BLIX-rating-scheme that may be used as a practical tool 
in instructional message design. 

Instructions on the execution had to be followed if reliable 
and satisfactory results were to be obtained. 
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Two of the visuals produced in the experiment with actual making of pictures. 
These visuals got BLIX ratings 4,8 (left) and 2,5 (right). Here the visuals are 
reduced and not in color. 



Revised BUX-raiing-scheme 

Questions Yes/No 
1 a) Color picture: Picture executed in a true-to-life color. 

b) Black & white picture: The contrast and gray scale in the 

picture arc clear. 
? The picture has a shape other than a square or a rectangle or 

covers an entire page. 

3 The picture has a legend which is brief, easy to understand 
and deals with the picture. 

4 The picture is unambiguous and not too "artistic", and 
ambiguous. 

5 The picture has a dominant centre of interest at or near its 
optical centre (middle of the picture) and few details which 
can be regarded as disuacting. 

Total number of yes answers. 

The total number of "yes" answers provides a direct value for picture readabil- 
ity in which 0 = "a virtually incomprehen<;ible picture", 1 = "very hard to 
read", 2 = "hard to read", 3 = "neither hard nor easy to read", 4 = "easy to 
read" and 5 = "very easy to read". 

BLIX must not be an end in itself. There is always a risk 
associated with index values since they can be interpreted as 
absolute values. BLIX actually represents the average difficulty or 
ease with which a picture can be read. It also yields some very 
valuable information and detailed knowledge on the importance of 
individual picture variables. The ability of the receiver to study the 
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contents of a word-picture message is likely to increase 
considerably if the word-picture is designed with this in mind 
Knowledge of picture readability, i.e. our total ability to interpret 
and understand a visual message in terms of our perception of the 
content, execution and context of the visual, enables us to make a 
visual description . 

A visual description is a description in words and outlines of 
a visual which does not yet exist. The accuracy with which the 
intentions of the instructor are carried out can subsequently be 
checked, at least in part, by means of picture analysis, i.e. an 
evaluative description of a visual, and partly by means of various 
practical tests. The results of these tests lead to a revised visual 
description which leads to anotfier still more effective instructional 
material etc. in a spiraling process of feedback interaction. 



Picture Quality 

A question such as "what is good or poor picture quality?" may 
seem trivial. But there is no widely accepted definition for 
"picture quality" nor any unambiguous or sufficiently 
comprehensive measure of this parameter. 

Any visual produced to convey information or knowledge 
must obviously contain the information to be conveyed. Such a 
visuaFs content, execution, context and format elicit a response, a 
perception, and possibly subsequent learning and memory. The 
information producer should produce representations in such a 
way that perception, on the average, is optimized. 

The sender of a message must define the objectives for each 
picture used. What emotions and information should the image 
convey? Who is the receiver? And in which medium will the 
visual be distributed? Correspondingly, the receiver (viewer) 
should attempt to identify the sender*s intentions. Which 
emotions and information are conveyed by the picture? Who is the 
sender? What are the picture's apparent objectives? 

Which pictures are "good" and which pictures are "bad"? 

In this context, "good picture quality" can be defined as the 
degree of coincidence between the sender's and receiver's 
subjective perception of the picture and the reality (external or 
internal) represented by the picture. 

According to this definition, the concept "picture quality" is 
related to the entire communications process, encompassing both 
sender and receiver, representation and reality. 

A "good" visual has a high level of picture quality. It is well 
worth reading and is executed so as to be legible and readable and 
be displayed in an optimum context in an appropriate format. The 
visual should convey information without ambiguity. It should be 
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stylish and attractive and is often, but not necessarily, also 
aesthetically pleasing. 

A "poor" visual has a low level of picture quality. It displays 
poor legibility and poor reading value. It conveys information 
poorly, is seldom aesthetically pleasing and often ambiguous. 

Reading value is governed by picture variables related to 
picture contents 

Legibility is governed by the functional properties of picture 
execution. 

Readability is governed by the functional properties of picture 
variables. A picture's aesthetic value is the aggregate effect of all 
picture variables. 




Reading value Legbilrty Readability Aesthetic va!ue 



A visual is well worth reading and has a high reading value when the content is 
interesting to the reader from a functional and/or from a semantic point of view. 
The legibility is mainly depending ot the execution of the visual. The readability 
is mainly depending on the functional properties of the visual. The aesthetic 
value of a visual is a combination of all the different variables. 



Measuring picture properties 
There are several ways of "measuring" picture properties. These 
"tools" can be used before the original is finished, before the 
technical production and after the actual publication of the images. 



Before the original 

A picture description can be drawn up on the basis of our 
knowledge of man s ability to interpret and understand a visual in 
terms of perception, contents, execution, context and format. A 
"picture description" is a depiction in words and sketches of a 
visual that does not yet exist. 
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Before technical production 

OBS and reading value ratings 

Larssen and Skagert (1982) employed two "preview tests" in 
order to assess reader response to as yet unpublished 
advertisements. A simple interview test provides a good forecast 
of future OBS (observation) and reading value ratings. The two 
central questions were (p.28): "1) If you encountered this ad in a 
newspaper, would you stop to look at it? 2) If you encountered 
this ad in a newspaper, do you think you would read any of the 
text in it?". When numerous subjects respond affirmatively, an ad 
can be expected to receive high OBS and reading valut ratings. 
The opposite is also the case, i.e. if numerous subjects respond 
negatively. 

Utility/Originality rectangle 

The second preview test entailed assessment of ads according to 
the concepts "utility" and "originality". First, the extent to which 
the reader derived any benefit fi-om reading or taking a closer look 
at an ad was rated. The rating scale ranged from "no utility" to 
"great utility". The degree of execution originality was then as- 
sessed. Ads with positive originality and great utility (field 1 in 
the "utility/originality" rectangle) were usually subsequently rated 
as "good ads" by readers. Publication of an ad with negative 
originality and little or no utility (field 4) is virtually pointless. 



Positive originality 
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Negative originalny 
The "utility/originality" rectangle. 
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Redundancy/Information 

Berefelt (1976) suggested that experience grows in steps in the 
power field l^ing between events previously observed and not 
observed, between the familiar and unfamiliar and between 
banality and originality. The greater the amount of infomuation 
supplied (the less the redundancy), the greater the amount of 
energy needed by the information recipient in order to register and 
comprehend the new data, Berefelt used a horizontal line with 
maximum redundancy and maximum (new) information as the 
linens theoretical end points to describe registration and 
processing of stimuli. Maximum redundancy elicits complete 
familiarity with the material, e.g. a picture. Maximum information 
elicits a total inability to comprehend the signals. Our perception 
of different pictures probably falls between these two extremes. 
Berefelt assigned seven proportionally spaced perception 
positions from an infinite number of possible positions on the 
line. These perceptions, from a high degree of redundancy to a 
high degree of information, were referred to as "boring" 
(unpleasant), "neutral", "harmonious" (pretty?), "fascinating" 
(nice), "interesting" (exciting), "neutral" and "irritating" 
(unpleasant). 

A picture creator who is very familiar with her/his target 
group can easily ensure that redundancyAinformation in a picture 
is on a lev J relevant to the picture's aim. The redundancy factor 
provides the picture creator with an opportunity to relate viewer 
perceptions to picture contents. 

Redundancylinforrmtionlcommunicative impact 
A refinement of Berefelt*s ideas could result in a model that also 
includes consideration of the communicative impact of pictures. 
Our perception of a picture probably affects the picture^s 
communicative impact. Pictures found to be boring or irritating 
are likely to have poor communicative impact. However, a picture 
perceived to be "wonderfully fascinating" is bound to be very 
good in communicative respects. The fact that the communicative 
impact of a given picture may differ for different people must 
obviously be kept in mind. Different people also respond to the 
redundancy factor in different ways depending on e.g. previous 
experience, social factors and cultural circumstances. So for these 
reasons, plus the fact that identification of the degree of both re- 
dundancy/information and communicative impact may be 
difficult, the model may be unsuitable for use in practical work. 
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Functiono] communic alive impsuot 




Boring Fascinaling Imtaling 

The redundancyfinformelion line 
The redundance/information/communicative impact modol (a). The 
communicative impact of a given picture may differ with different people (b and 
c). Different people respond to the redundancy factor in different ways (d and 
e). 

InterestlPerception 

In a world in which it is becoming increasingly difficult to avoid 
unsolicited information and, at the same time, increasingly 
difficult to find information we really wish to find, our interest in 
material may be / xisive to the way in which we perceive that 
material. Interesting material arouses our emotions to a greater 
extent than material we regard as boring. The degree of interest 
can be described with a rating between "no interest at all" and 
"maximum interest". So the interest factor is one way to define 
the viewer s relationship to picture contents. When interest is 
zero, our emotional response is negative or, possibly, indifferent. 
Emotional response increases as the interest factor increases and 
becomes increasingly positive. However, a given picture may 
evoke different emotional responses in different people, even 
when they share a common degree of interest in the picture. 
Different people also perceive the interest factor in different ways. 
As is the case with the Redundancy/ Information/ Communicative 
impact model, the Interest/Perception model may be hard to use in 
practical work. 

The Legibility/Reading value rectangle 

A picture can also be rated according to legibility and reading 
value. First, the extent to which the picture is readable for the 
intended reader is rated. Does the picture have considerable 
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reading value and interest or does it have poor reading value and 
little interest? The picture's legibility is then rated. Is the picture 
distinct and easily read or is it indistinct and difficult to read with 
a view to its execution? An informative picture with positive 
reading value and legibility (field 1 in the "legibility/reading 
value*' rectangle) is probably "very good". A picture is "good" if 
it is readable but difficult to read. The picture is "bad" if it has 
limited reading value and is easy to reaf^ * ^ bad" when it 
has poor reading value and is also diffi* initial experi- 

ments suggest that a preview test of t.*j. > ild pjt)ve to be 
very useful. 
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The "Legibility/reading value" rectangle. 
Picture readability index 

A picture's readability can be assessed by calculating the BLIX- 
value.BLIX was designed for informative pictures. It takes 
functional picture properties into consideration and is a measure 
of the ease or difficulty with which a picture can be read. A 
picture that is incomprehensible is incapable of conveying any 
factual information or knowledge. Its functional, communicative 
impact will then be very slight. The greater the readability of a 
picture, the greater its functional, communicative impact. 
Different people obviously respond in different ways to different 
pictures. 

In the correspor ' .ig manner, a suggestive communicative 
impact can be discussed as a function of BLIX. The correlation 
here is the antithesis of the previous correlation since the 
suggestive, communicative impact is high when the BLIX rating 
is low and low when the BLIX rating is high. 
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After publication 

A picture analysis, i.e. a descriptive rating of a picture, and 
various practic^ tests can be carried out to determine whether or 
not an information disseminator's intentions are accurately 
realized. The results of these tests can be used for revision of the 
picture description which, in tum, could result in even more 
effective informative material etc. 

Picture analysis 

A picture analysis can comprise a description and, possibly, a 
rating of picture language, contents, execution, context, format, 
medium, distribution method, sender, receiver, objectives etc. 
Different sets of questions can be used in picture analysis 
depending on the objective of the analysis. The following 
questions may be useful in a brief, general analysis. 

• Visual language Is the visual language clear and distinct? h the 
visual language adopted to the culture and to the audience? Is 
the picture's "meaning nucleus" obvious? Does the pictuie 
contain a lot of insignificant information? 

• Content What is (are) the subject/s in the visual? Is (Are) the 
subject/s easy to understand? What are the relationships of 
different subjects? Is one part of the picture dominating over 
the others and why? Is the picture a typical or a non-typical 
example of the subject? What is the degree of realism and 
details? What is the degree of credibility? How are motion, 
time, sound and emotions expressed? 

• Execution What type of visual is it? Is the subject large and 
clear? What is the shape, size, color and contrast? How is the 
composition in terms of organization, centres of interest and 
balance? What are the depth, picture angle and picture height? 
What is the technical quality like? Does the picture have sym- 
bols and explanatory words? 

• Context What is the context? Is there a legend, texts, other 
pictures or sound in connection with the picture? How is the 
layout done? 

• Picture readability What is the picture readability index 
(BLIX): 

• Medium In which medium is the picture used? Is the picture 
used in mass-media, in group media or in personal media? 

• Distribution How is the distribution organized? 

• Sender Who is (are) the sender/s? Who is (are) the producer/s? 
Are the views of the sender important to the use of the picture? 

• Receiver Who is (are) the receiver/s? Do the receivers form a 
homogeneous group? Is the group small or large? 
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• Aims Why has the picture been produced? Has the picture been 
produced for advertising? Are "hidden" intentions imbedded in 
the image? 

• Impact Is the picture likely to have an effect on learning, 
human feelings, attitudes or opinions? What impact is it likely 
to have? 

The various preview tests can also be transformed into true 
readability tests. The results of these tests can also lead to revised • 
picture descriptions... 

Peterson (1984) is working on an analysis of comic strips 
and has proposed the following model (p. 104) based on a 
semantic approach. 

• An analysis of the storyline. Which hidden values do the 
figures represent? How are conflicts presented in the story? 
How are conflicts resolved? Are any myths created? 

• An analysis of picture structure and meanings on both 
denotative and connotative levels. When characters conveying 
meaning are interpreted, both internal and external context are 
taken into consideration. 

• An analysis of the importance of balloon texts. 

• A study of the location of emphasis in the communications 
process. 

This should to identification of the comic stripes 
furiv*:ion, e.g. to jtic or challenging. How is imagination 
employed? In emancipative, compensatory or 

powerconfirmative manner? Which attractive properties do the 
pictures have? Fascinating, aesthetic shapes? Do they play on any 
particular emotions, needs or dreams? Which dialectic 
relationships prevail between the strip's design and e.g. .receiver 
context? 

Values and attitudes 

Semantic differential scales in which the sender and/or receivers 
report how positively or negatively they respond to a given 
picture in overaP terms or with respect to individual picture 
variables can also be employed in measuring how "good" or 
"bad" a picture is. 

Semantic differential scales can comprise e.g. general attitude 
toward a picture (Bad-Good), aesthetic value (Ugly-Pretty), 
reading value (Uninteresting- Interesting), technical quality (Poor- 
Good), legibility (Hard to read- Easy to read), educational value 
(Slight-Great) and credibility (False- True). The combination of 
verbal and numerical scale steps makes possible staiir<Ic\. 
calculations of e.g. mean values, standard deviations and conti- 



ERIC 



180 



181 



dence intervals. This makes the method very suitable for large 
groups of subjects. 



Classifications of visuals 

A visual always has a sender and a receiver, as can be seen in the 
communications models. A visual also has a content seen in the 
in*age. The visuals is ex? ;cuted e.g. as a drawing. It is structured 
or executed e.g. accordmg to size, shape etc. The visual has a 
physical form, a format, e.g. as a 35-nim slide. The visual is use<! 
in a context, e.g. as an illustration in a textbook. 

Visuals can be classified according to various criteria such as 
sender, receiver, content, execution, format and context and even 
according to criteria such as function, use and the means of 
production etc .Thus, there are many possibilities for 
classification. However, one and the same visual can and will be 
classified in different ways at the same time depending on the 
criteria applied. Often the borders between different groups 
partially overlap each other. The follov^ing is an attempt to exem- 
plify one model of classification. 



The Picture circle 

Many visuals are made to effect us in one way or another. 
Pictures which affect us in an unambiguous way can be referred 
to as symbols. Signposts, traffic signs, labels etc. belong to this 
category. They are unambiguous by convention. We agree and 
decide on their meaning. 

All other picmres are representations of reality and depict the 
physical structure of the objects they represent. As is the case for 
other kinds of representations, pictures are always open to 
different interpretations by different, people at different times. 
Some pictures are open to many interpretations, others to only a 
few . 

Ambiguous pictures, which often express moods and 
emotions, arc usually referred to as suggestive pictures. Even 
here the creators of the pictures are out to in^.uencc ihe viewer in 
some way Paintings often belong to this category. It is often 
difficult and sometimes impossible to make clear distinctioLS 
between different kinds of pictures. Advertising pictures, 
propaganda pictures, pictures for information or instruction or 
educational pictures can be both ambiguous and unambiguous. 

The role of a picture for instruction may be to convey a given 
piece of information in ihe simplest and most effective manner 
possible. But the picture may also have the task of conveying 
moods or to arouse the viewe^^'s interest and involvement by 



O 182 

ERIC 



181 



disseminating certain information. An example of the latter might 
be information on conditions in other countries. 

Objective documentation of a product, situation or course of 
events by means of X-rays, ECG, EEC, satellite photographs, 
thermographic pictures, ultrasonograms, photographs, drawings 
and charts is often necessary. These pictures are frequently 
realistic and simulate reality in ways unique to each 
documentation process. Apparently objective documentation can 
occasionally be extremely subjective and suggestive when the 
choice of images, the cropping, layout and caption contents are 
ovenly selective. The expression "the camera never lies" can often 
be very wrong indeed! 

As far as ambiguous pictures are concerned, there is often a 
major difference between their denotation, i.e. their literal 
meaning, and their various connotations, i.e. their associative 
meanings. By e.g. exaggerating perspective, deforming shapes, 
making symbolic use of color etc., a picture creator can easily 
create works which evoke extra associations in viewers. ">is is in 
fact the very idea behind an artistic picture. However, the in- 
formative picture should not be open to different interpretations. 
The picture*s message should then be the message intended by the 
person/agency commissioning the picture. 

A hand-crafted visual such as a painting, drawing, diorama or 
sculpture takes a long time to make, is highly personal, exist only 
in individual, unique copies and only reaches a narrow public. 
Pictures made by children, for example, often display 
considerable spontaneity and reveal a great deal about the 
crsonality, degree of development and maturity of the children. 
in all hand-crafted pictures the relationship of information 
presented to reality is totally controlled by the artisn Photographic 
pictures are rc;cords of an event or object which actually existed. 

Technically crafted visuals can be made in a relatively brief 
space of time and easily reach a wide public. A TV cam.jra can 
take live pictures viewed simultaneously by millions of people in 
different countries. In this way, we can "attend" various 
happenings, such as sporting events, no matter where ihey occur. 
The ease with which news pictures can be produced and dis- 
tributed may influence the selection of pictures. Sensational 
events, such as a disaster, may be assigned a relatively large 
amount of space in the mass-media because pictures such as these 
attract widespread interest. Here, the mass-media people bear an 
enormous responsibility in their editing and ^election of pictures. 

Hand-crafted pictures are now easy to reproduce in 
newspapers, books, television etc., but the technical reproduction 
processes do rob them of some their original character. The 
halftone dots of the printing process or the special characteristics 
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of electronic images are incapable of doing justice to e.g. a 
painting made with vivid colors and applied paint. This is even 
more true for sculptures, dioramas and other 3-dimensional 
pictures. In the future, holograms, stereo and laser techniques 
may hopefully solve some of these problems and re-create the 
third dimension. Current methods for making 3-diroensional 
pictures still require considerable development 

The manner in which we perceive a picture and the efficiency 
with which the image communicates the image creator's intentions 
depends not only on the technical reproduction method chosen but 
even on the manner and presentation to a large degree. We often 
need help and guidance in order to interpret a picture's message. 
Different captions or sound effects enable us to respond to one 
and the same picture in widely differing ways. This is especially 
true of moving pictures. The relaUve size of the picture, cropping, 
lighting and the location on the cover of a book or newspaper 
page are also important to the way in which the picture is 
perceived by people with differing values, feelings, attitudes, 
experience, background k.".owledge and philosophy. Pictures 
often serve as amplifiers, i.e. the viewer of:en readily accepts 
information verifying his own opinion on a given issue. 




The picture circle 

Picture are always related in some way to rer.lity. Bui they 
must never be confused wi'ih reulity and are incapa' of replacing 
reality.The "picture circle" is an attempt to provide a simple 
graphic description of the relationship between different types of 
pictures. "The spot in the centre, the "bull's eye", represent 
scribble which is the same all over the world and our first attempt 
to make pictures. 
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Increasingly advanced picture techniques have evolved from 
scribbling. This development can be represented with a series of 
concentric circles. Scribble is followed by handicrafted visuals. 
Drawings with a pencil, charcoal, crayons and pens; paintings m 
water colors, acrylics, oils etc. simple flipover moving pictures, 
castings, models and sculptures of clay, plaster-of-Paris, wood, 
metal e t c are all examples. The borderline between handicrafted 
and technically crafted visuals is indistinct. Some picture 
techniques represent both hand-crafted and technically crafted 
methods. "Hand-made" prints, linocuts etchings, lithographs, 
seri jraphs e t c ar'^ examples. AH handicrafted pictures can now 
be reproduced in any quantity desired with the aid of processes 
such as letter-press, offset, intaglio printing e t c. ExampLb of 
other technically crafted pictures are different types of machine- 
made prints, photos and films, electronic pictures, thermographs, 
radiographs, ultrasonograms, ECG and EEG records etc. The 
outermost circle is occupied by various 3-dimensional pictures 
such as holograms. In the future, they should be capable of 
making the closest conceivable approach to the reality 
surrounding the circle. 

Every ring in the circle encompasses symbols, such a.s signs, 
signposts tc., suggestive pictures with mythological 
representations, artistic pictures, advertising, propaganda 
pictures, news pictures etc., realistic pictures for objective 
aocumentation, and schematic pictures such as blueprints and 
maps etc. The borderlines between these categories i? indistinct. 
Some visuals may be considered as suggestive pictures in one 
context but as realistic pictures in another context. 



Symbols 

Taking up only a very small amount of space, symbols can 
convey a message containing a large amount of varying 
information, equivalent to one or more sentences of text. Image 
perception is very rapid, virtually "instantaneous'*. Reading and 
comprehending the equivalent message in words takes much more 
time. So symbols permit rapid reading. This is important in nu- 
merous situations, e.g. in traffic, industry and aviation. 

Symbols are often composed of simple graphical elements, 
i.e. lines, circles, ovals, squares, rectangles, triangles or 
combinations thereof. Distinctively shaped letters are often 
utilized. 

Symbols often employ bright colors, such a pure yellow, 
red, blue or green,white and black or combinations of same. 

Shape and color components are often used for designating a 
link or relationship between groups of messages. In traffic, for 
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example, a triangle is used for warning signs, a circle for 
restriction signs and a rectangle for informative signs. 

A good symbol is designed so it can be used in many 
different situations. For example, the MacDonalds M is designed 
to woric in every conceivable size from a few millimetres high in a 
brochure to more than six feet high in outdoor signs. 

Symbols can be used for creating an overview and providing 
a holistic perspective. This property is utilized in maps and 
informative signs as well as in e.g. catalogues and project reports. 

Symbols can be used for supplying instructions and 
informatic n about appropriate behaviour in different situations. 
Numerous exaniples can be found in catalogues and timetables. 
Various traffic signs also belong to this category. 

Symbols can be used for illustrating the spatial and 
geographic position of different objects or services. One example 
is the floor plan of an exhibition hall with symbols designating the 
location of telephones, lavatories, information booths and 
refreshment sites. Other examples are maps with numerous 
cartographic symbols foi objects and conditions. 

Symbols can be used for illustrating size relationships and 
supply numerical/statistical information. Some diagrams and 
many symbols in maps are examples. 

Symbols can be used to represent an organization, service or 
product. Trademarks and logos are utilized in marketing, 
advertising, public relations etc. As a rule, promotion of the 
representation begins with text {e.g. a company or product name), 
followed by text + a symbol. Ultimately the symbol alone 
suffices. Examples: MacDonald's yellow M and Shell's scallop 
shell. 

Symbols are employed in different media. They are static and 
immutable in graphical media. They may be more changeable in 
computer media. When you select e.g. a brush in the menu for a 
Macintosh drawing program, the brush ikon switches from 
positive to reverse vid^o. This "acknowledgement" shows the 
user that the command has been understood. This makes 
communications more "reliable". 

Every situation/context demands consistent utilization of 
symbols, an explanation of the symbols used and learning the 
meaning of those symbols.Well-designed signals can be used and 
work in different cultures in different parts of the world. 



Computer pictures 

Computers are currently capable of displaying many kinds of 
pictures on their monitors. Rapid technological innovations 
constantly increase the range of images displayable by computer. 
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Computer-displayable pictures are always converted to digital 
form at some stage, i.e. l series of zeros and ones. The computer 
can process picture information as vector or pixel images. A 
vector image is based on mathematical functions and composed of 
lines and closed polygons. A pixel image is composed of a large 
number of individual picture elements, i.e. pixels whose gray 
scale and color scale are variable. The following classification, 
based on picture function and intended use, is proposed to 
facilitate discussions of various issues in the field of **computer 
pictures". Computer pictures may be classified in four groups: 1. 
Computer processed pictures, 2. Pictures analysed by computer, 
3. Computer geneiated pictures and 4. Computer distributed 
pictures. 

1 Computer processed pictures 

Computer systems are being used to an increasing degree for 
editing, correcting, processing, retouching and supplementing the 
contents of pictures for e.g. books, magazines or other printed 
matter or for slides or overhead transparencies. The basic picture, 
such as a drawing or photograph, must be digitized with the aid 
of a bcanner or special video camera. The computer can then feed 
the digitized images to some peripheral such as a laser printer, dot 
matrix printer, plotter, film or printing plate. 

Satlight was used for the first time during the 1984 Los 
Angeles Olympics. Pictures were scanned, compressed by a 
computer, processed and sent by satellite to a receiving station in 
London. Pictures were stored on magnetic tape and distributed to 
various newspapers. 

2 Pictures analysed by computer 

Pictures analysed by computer may be divided into the following 
two groups: 1. Measurement pictures and 2. Photographic 
pictures. 

2. 1 Measure*^ent pictures 

Measurement pictures are representations of various 
measurements in e.g. medicine. Ultrasonograms and CaT scans 
are examples of pictures employed for identifying differences in 
the density of body tissues. The brains activity can be vicualised 
and measured with a positron camera. Measurement of thermal 
radiation is another example. 

2.2. Photographic pictures 

Photographic pictures are of several origins. Satellites with 
multispectral scanners continuously record and uansmit digital TV 
images of the Earth. These images are analyzed and ubtd for 
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many different purposes in meteorology, geology, agriculture and 
forestry. The interpretation of satellite pictures is a widespread 
activity. Photographic pictures are also used for a wide range of 
military applications. 

3 Computer generated pictures 

The ''concept computer-generated pictures", i.e. computer 
graphics, is employed in many different ways. However, image 
generation by computer is the common denominator. Computer 
generated pictures may be divided into the following four groups: 
1. Computer art, 2. Information graphics, 3. Design pictures and 
4. Entertainment graphics. 

3.1 Computer art 

Computer art is a young art form comprising visual presentations 
whose aesthetic aspect predominates. Computer art consists of 
images created on an interactive basis and of images and patterns 
generated at random. Computer art often contains animated 
sequences and is displayed at e.g. exhiuitions, art galleries etc. 
Computer art can also be displayed on paper. Image info.:mation 
is often stored pixel by pixel, and not as mathematical functions. 

3.2 Information graphics 

Information graphics may be divided into two subgroups, 
business and news graphics. 

Business graphics are graphic presentations of numeric 
information (statistics). Sales, stock or production statistics are 
often illustrated with graphics. If the values of individual 
variables are stored separately, the user is often able to illustrate 
the information in different ways. Histograms, bar charts, pie 
charts or curves are examples of the options available. The 
graphics are usually reproduced on film (as a slide or overhead 
transparency) or paper. Grahics are being used to an increasing 
degree for presenting information in research and development. 

News graphics often serve as informative decoration. These 
pictures are utilized in TV news programs, weather forecasts and 
vignettes announcing new numbers in entertainment programs. A 
programs title graphics can be e.g. rotated, turned or made to 
gradually emerge from the background. News graphics are also 
used in movies. A- V presentations and graphic prcducts. 

3.3 Design pictures 

Design pictures comprise the subgroups drawings, maps and 
patterns. 

Drawings, two-dimensional representations of mathematical 
descriptions of objects, can be generated by various CAD 
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(computer-aided design) systems. The systems are often able to 
"twist and turn" a depicted object to show it from different angles 
before the object ever leaves the drav/ing board stage. Car parts, 
ships, aircraft, machinery, buildings etc. are examples of objects 
being designed with the aid of CAD. CAD systems are often used 
in conjunction with CAM (computer-aided manufacturing) 
systems. 

Maps are successfully produced in CAD systems, combined 
with vector systems. The systems make It easy to change both the 
scales and contents of maps. 

Patterns, e.g. for textiles are also produced in CAD systems. 
But these CAD systems can also be used for producing patterns 
for e.g. wallpaper, wrapping paper and book covers. 

3.4 Entertainment graphics 

Entertainment gi-aphics such as electronic games and animations 
are also produced in computer systems. Many kinds of interactive 
electronic games are on the market. Players manipulate space 
ships, robots, heroes and bandits in fantasy worlds. The 
electronic games often feature dramatic colors, symbols, changes 
in perspective and sound effects. Developments move at a furious 
pace. Only a few years ago, graphics were very primitive, but 
their sophistication and resolution have been vastly improved. 
Animation is becoming increasingly commonplace. Computers 
are being used to create advanced animation effects in movies, TV 
and video . Some examples of computer-animated 3 dimensional 
films in color were shown at the 1985 Tskuba Expo in Japan. 

4 Computer distributed pictures 

Computer distributed pictures may be divided into the following 
two groups: 1. image data bases and 2. Fax. 

4. 1 Image data bases 

Various forms of videotex belong to this category. They all entail 
transmission of information via the ordinary telephone network. 
Several online systems have very high transmission 
capacities.These systems usually store their information on 
.magnetic media. 

Optical storage media have a much greater text and picture 
storage capacity (hundreds of thousands of documents on each 
storage unit) than magnetic media. Each of the stored documents 
can be quickly retrieved and displayed on a screen or printed as 
hard copy if deshed. Filing is a main application for optical 
storage media. 
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4.2 Fax 

Fax is a collective designation for electronic copying and 
transmission of text and/or pictures to a receiver in which a 
facsimile of the transmitted information is reproduced . 



Pictu"*e archives 

Pictures are now being created more rapidly than at any time in 
history. Millions of pictures are produced every day. Sweden 
alone (with a population of 8,3 million) accounts for more than 
200 million amateur photographs each year. And each of the 
country's 2,000 professional photographers produces a half 
million photographs before retiring. Many pictures are put to 
active use in various ways. But a large proportion end up in 
collections. Some collections evolve into archives. There are four 
main types of archives: 

♦ Personal, private collections 

♦ Commercial photo agencies 

♦ (Personal) research archives in different fields 

♦ Collections in museums and other public institutions 

Many photo collections are small enough to be accessed 
without any special index. The owner knows which pictures 
she/he has and where they are stored. This ease of access is no 
longer possible in large photo archives holding hundreds of 
thousand or even millions of photographs. So a large number of 
different indexing systems have been devised. Pictures may then 
be indexed according to category, motif or subject. Era, 
geographic area and persons may be other classification concepts. 
Accession and negative indices and information on the dates 
photographs were taken, copyright etc. may also be provided. 
Commercial photo agencies usuall j permit direct, manual and 
visual perusal of originals or copies in each category. The feeling 
here is that the indexing or cataloguing of individual photographs 
takes too long, costs too much and conveys no decisive 
advantages. Institutional photo archives, as used in research and 
education, are usually unable to manage without some kind of 
cataloguing. Many indexing systems are based on hierarchic 
classification of picture subjects according to some pre- 
determined code or on systematic catalogues in which every index 
word has a corresponding alphabetical or alpha-numerical 
designation. 

The Inconclass system, developed in Holland, has a 
systematic catalogue on theological subj" ts. The system is often 
used for classifying rrtistic pictures. Each picture can be assigned 
a classification comprising a few index words/codes. The method 
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is based on a description of the picture's main subject. Picture 
details and minor subjects cannot be indexed . 

Many museums use Outline, i.e. OCM (= Outline of Cultural 
Materials), for classifying pictures. Outline was designed to be a 
general classification and code system for social and cultural 
subjects and operates with computerized routines. However, 
finding codes (headings) which describe true picture contents is 
as hard with Outline as Iconclass. So classification is influenced 
by the perceptions of the individuals doing the coding. This 
makes it difficult for a visitor to find pictures complying with 
her/his requirements. Similar results have been obtained with 
many systems in other countries. The Iconograhi:: Archives in 
Uppsala, in Sweden, employ a system with a much finer "mesh". 
Here, pictures with subjects in the field of ethnology/cultural 
history (e.g. ethnographic or folk-loristic scenes) are recorded. 
The date a photograph was taken, its country of origin and the 
source are recorded for each picture. After an analysis of the 
picture contents, the main subject and minor subjects are then 
recorded according to a systematic code catalogue subdivided into 
subjects. The entry of search conditions combined in different 
ways results in fast computer extraction of information on 
whether the desired picture subject is on file. 

Results obtained in the U.S. suggest that classification and 
searches based on various code systems seldom work 
satisfactorily at large picture collections or photo achieves. 
Greater success has been obtained at archives in which search 
words are listed alphabetically for each subject. Modern 
computers are capable of processing plain language search words 
as easily as more succinct codes. Utilization of plain language 
words obviates the need for users to rely on archive specialists or 
learn special code systems when searching for a subject. 

APIS (Agency & Photographer Information System), 
developed in the Federal German Republic, is a computerized 
system for managing picture archives and all the administiation 
related to the lending of pictures and selling of rights. A serial 
number, heading number, a key word describing pictures 
contents, the photographer's name and the copyright holder are 
recorded for each picture. This information is printed on a label 
which also bears an optically legible bar code. The label is 
attached to the back of prints or to mounts of transparencies. All 
captions are stored in a database for full text searches. Desired 
photographic subjects can therefore be accessed very quickly. 
Photographs can be filed in numeric order or by subject 
(heading). The latter system makes it possible to ci iduct manual, 
traditional searches. The bar-code is read with a light pen for 
rapid entry of information on all pictures borrowed and returned. 
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The system also supplies invoicing, bookkeeping, statistics, 
detailed reports to the photographer and other copyright holc^xs 
etc. plus other administrative information. 

Spectrum, the Dutch publisher of reference books , has 
developed an advanced system of databases for both text and 
picture administration (Thesaurus). The company has indexed 
45,000 illustrations, each accompanied by information on up to 
seven parameters. These pictures have been published at 90,000 
locations in different reference books, in various sizes, with 
different cropping etc. The computer system contains all relevant 
information on the illustrators/ photographers, copyright, costs, 
disbursements, archive locations of originals and films etc. The 
system offers several different ways of searching for pictures by 
means of search words. 



Picture databases 

The ability to store photographs in a database for simultaneous 
display of pictures and texts would be an attractive option to most 
people with a picture archive and facilities for database searches 
of indices or texts. A picture stored in digital form requires a vast 
amount of storage space compared to text. So some systems 
employ analog storage of pictures. An optical video disc Is 
capable of storing up to 100,000 PAL-TV-quality images, i.e. 
250,000 pixels per picture. Pictures are individually numbered 
and can be sought and displayed within seconds. Spectrum has 
stored its 45,000 pictures on a single analog, optical videodisc. 
The disc is used as a kind of "catalogue" in inarketing the picture 
archives. A customer can obtain all th« facts about a sought 
photograph on computer screen at inC same time as the 
photograph is displayed on a TV monitor. A similar system has 
been developed by Image Bank, in collaboration with Brignoli 
Inc. in New York. Video discs holding picture archives provide 
people In different parts of the world with access to pictures 
previously unavailable to them. Art treasures from the world's 
leading museums can be displayed to the public, scientists and 
educators using this medium. 

The"InternationaI Veterinary Pathology Slide Bank" has been 
transferred to a video disc at the University of Georgia in the 
U.S. However, indexing the pictures has proved to be extremely 
difficult (Trice, 1986). Veterinary experts have been unable to 
agree on the most essential feature of each slide. So assigning 
multiple headings and index words for each picture is necessary. 
Full text searches are then made in a database. The Dutch pub 
lif^her VNU New Media announced in 1986 their videodisc 
MEDDIX data with a collection of 30,000 medical slides for 
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diagnosis and training. This system uses a highly advanced 
computerized thesaurus with cross-references between key- 
words. Images are also accessed by the use of a free-text 
database. In 1986 "The National Iconographic Research Center" 
in France also announced an interactive videodisc with 100,000 
medical images with their captions. Even in systems in which text 
and pictures are stored on the same medium and displayed on the 
same screen, searches for picture contents can only be made, in 
practice, by meanr of verbal descriptions of main or minor 
subjects. 

A large number of indexing systems has been devised to 
guide access to individual images (Pettersson, 1986a). However, 
real life experience, as mentioned above, shows that it is often 
very hard to find the intended image. It is known from several 
experiments that images are perceived in many different ways by 
various subjects (Pettersson, 1985, 1986 b). Even simple line 
drawings evoke many associations. Vogel et. al. (1986) Si.owed 
that image-enhancement intended to improve interpretation^ of 
image content sometimes got in the way of the message. The.y 
concluded that image-e»ihancement graphics should be used 
selectively and carefully. When in doubt, they recommended, 
plain text should be used. Limburg (1987) pointed out that 
receivers have even more ambiguity or semantic diversity with 
visual images than with most expressions of written language 
with its manifold meanings. Lodding (1983) r^-ported on the 
problems with misinterpretations of icons used in computer 
systems. However, he concluded that people find naturalness in 
dealing with images either as an aid to or, in some circumstances, 
as the sole means of communicating. 

A picture in a database can be sought wi.h the aid of verbal 
and visual indices.Each picture has a picture number as a heading 
and a verbal description. The pictures can be listed systematically 
in numerical order in a numerical index. Or they can be lisfed in 
alphabetical order (according to their headings) in an alphabetical 
index. Picture descriptions are stored in a free-text (or full-text) 
database, making it possible for users lO access a picture via a 
number of different descriptive terms. 
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Pictures 



Codification 



Technical 
production 



Picture 
archives 



Picture 
database 



Visual 
display 



Verbal index 



Visual index 



111 picture archives pictures are stored as objects, that is as originals or as 
copies. This is a primary storc.ge. For storago m picture databases a 
transformation of the image content to analogous or digital signals is needed. 
This is a secondary storage. Individual images can be found with the use of a 
verbal and/or verbal-numerical index. For technical production and e.g. mass 
communication pictures are taken from picture archives and image signals are 
collected from picture databases. 



Numerical Index 



I93ihe eye 

184 the eye in profile 

185 the eyebaJ^ 

186 the Inierior 

1 87 the cornea 

188 the pupil ccnstricis 

189 the pupil dilates 

190 the lens 

191 the ciliary ligament 



Alphabetical Index 



ey© 183 
eye, ant. chamber 1 79 
eye, pos. chamber 186 
^ 18 5 

-/9£pct 152 
eye^rxind 942 
e>iB lashes 194 
eyeid 1 77 



Full text 



Each eye is rrioved by six 
ocular muscles. The supe 
rior, the inferior, the la- 
teral and the medial rectus 
ocular rnusdes move the 
eyebalKr up, down, to the 
side, or toward the nose, 
respectively. The superior 




A verbal search for a picture. Example taken from a numerical index, an 
alphabetical index and a free-text database. 
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A verbal description of a picture should be rather 
comprehensive. It may sometimes apply to an entire picture 
series. A database search based on certain descriptive terms could 
produce several differenc pictures with the same description. All 
such pictures would then be displayed in separate "windows" on 
the terminal screen. Entry of a command causes full-screen 
display of any of the windowed pictures. For children it might be 
easy to point with a finger at the window on the screen. Pictures 
can be stored in files stored in other files etc. in a kind of a tree 
structure. When a file containing pictures is opened, the file 
contents are displayed in "w.iidows" which can be as small as 1.5 
X 1.5 cm. Thus, verbal searches are used on higher levels and 
visual, iconic searches on lo^^^er levels in the storage structure. 
Users who knows in which file a desired picture is resident can 
go straight to that file. Index searches are employed when the 
whereabouts of a given picture is unknown. 
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A visual search for a picture. Examples of "windows" shown on the screen. 



Research is being conducted on the possibility of using a 
computer to search picture files for image structures or patterns. 
So far, these system have very limited capabilities and are only 
being employed in e.g. industrial robots programmed for taking 
certain components from a conveyer belt and creating assemblies 
with other components. Developments are most advanced in the 
military sector, e.g. in target-seeking missiles capable of reading 
terrain and comparing readings to a pre-programmed map and a 
predetermined route to the target. 
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But there is yet another major, unsolved problem, since one 
and the same structure may occur in different pictures. Empirical 
studies (Pettersson 1987) have shown that subjects given a 
number of image elements combine them to form many different 
picture contents. 



Picture dimensions 

The development of different compact discs will open up 
fascinating, new opportunities to producers of e.g. teaching aids. 
They will make it possible to create "the total teaching aid" 
encompassing text, sound, pictures, numerical information and 
opportunities for various kinds of information processing in a 
single medium. A "total teaching aid" is a multimedia database 
offering the user complete freedom in moving back and forth be- 
tween verbal, numerical, visual and audio information. This will 
enable children (and adults) with all kinds of modalities, i.e. 
verbal, visual, kinesthetic or mixed modalities, to actively seek 
and find information which is actively transformed into 
experience and knowledge. (Cf. Duffy 1983 for a discussion on 
modality.) In supplying answers to assignments or writing 
reports, students will have easy access to the necessary 
backgiOund information. They will also be able to retrieve 
suitable examples, i.e. "quotes" from tht individual databases, 
and incorporate them into their own presentations. Numerical in- 
foimation in tables, for example, can be processed and presented 
as bar charts, curves or pie charts providing a better overview. 
(Cf. Pettersson 1984 for an overview.) A teaching aid could also 
contain different kinds of computer-based educational games and 
the like. 

Kindborg and Kollerbaur (1987) points out that the use of 
graphical interfaces has made computers easier to use for people 
who are not computer experts. Visualization of system status and 
of on-going processes has enhanced the user s understanding of 
iiow various computer-based tools work and can be used. The 
Dynabook system (Goldberg et al, 1977) and the desktop 
metaphor of the Xerox Star system (Smith et al, 1982) and their 
successors are well known examples of graphical interfaces. One 
reason for their success is that the visual presentation techniques 
employed communicate the model of the system to the u.>er in a 
clear way. In addition, interaction with a graphical interface is 
often considered to be stimulating and fun. In fact it is easy for a 
child to learn to use graphical interface computers like the Apple 
Macintosh. 

Every published photograph has been involved in a selection 
process, not just once but repeatedly. First of all, the picture 
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creator (photographer or artist) makes an extremely narrow 
selection from all the pictures which could be created on any 
given occasion. The picture editoi then makes a selection from 
numerous alternatives in a collection or archive. As far as drawn 
illustrations are concerned, a number of alternative sketches often 
serve as the basis for discussions on the appearance of the final 
originals. So a picture only depicts a selected slice of reality, one 
person, one object or one event, for example, always surrounded 
by undepicted things and circumstances occurring before and after 
each selected picture. Most graphic products can only display a 
rather limited number of pictures depicting a situation. However, 
an optical/electronical system is capable of storing an extremely 
large number of pictures which need not be cropped as severely 
as "print published" pictures. So the user has a greater 
opportunity to utilize picture information as a "resource," 
"information bank," and retrieve information that is relevant and 
of interest on any given occasion. 




Search options m databases with verbal, numeric, visual and audio information 
There are always four vvays to proceed. The user can remam in the same 
database or switch to any of the others at ease. 

A stored image is much larger than the image displayed on the 
screen. Only the central part is displayed. The entire picture can 
be viewed by scrolling the screen image up or down or to the 
side. Horizontal and vertical rulers with cursors outline the 
position of each displayed image window. 

Here, electronic media are completely superior to all 
traditional media. For economic reasons, a book cannot contain 
multiple versions of a picture with different croppings. The 
sender*s perception of what is important is the deciding factor in 



1 



197 



the choice of the picture selected for publication. With use of the 
"total teaching aid" the user of the system, the learner, can decide 
what is imponant to her or to him. 




The central (lighter) part of the image is displayed when the system starts. The 
image shown on the terminal screen is outlined by the inner frame and cursors. 
Here and in the following (printed) examples only a small picture is used ( four 
times the size of the screen.) Much larger pictures can be stored. 




Scrolling the image up or down or to the side provides access to the entire 
image. Here, the viewing window has been shifted so the segment at the top 
left is the one displayed on the screen. 

How can you get an overview? The stored image can be 
shrunk to a fraction of its normal size so the entire image fits on 
the terminal screen. 
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The picture has boen shrunk (m this example to one-fourth) so it all fits on the 
terminal screen. 

How can picture details be viewed? You can zoom in on any 
detail displayed on the screen by enlarging that part of the image, 
thereby changing the scale. The result is like viewing part of the 
picture through a magnifying glass If sufficient computer and 
storage capacity is available, stepless enlargement or fixed, 
multiple degrees of magnification could be allowed. Image 
magnification or shrinkage does not change image contents but it 
can have a major impact on image perception. 



Enlargemant of a detail in the framed section of the image can fill the entire 
screen. You can gradually zoom in on any section of the displayed image. 

Possibilities for enlargement is already available in several 
s>i>tems. In the future this will probably be standard and with 
tetter and tetter performances. 

How can an image te processed? Modem, computer-based 
systems for processing graphical images offer wide-ranging 
opportunities for simple editing and manipulation of image 
contents. In addition to changing scale, as previously mentioned, 
the user can change projection, crop or expand, reduce, delete, 
modify, move, turn, supplement, isolate or combine various 
image elements . Pictures can be stored as object oriented 
descriptions, in bit-mapped form or as a combination of same. 
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Cropping 

An original picture can often be improved by removal of irrelevant 
or distracting elements. Pictures can be cropped from all sides. 
The photographer always performs some ininal cropping, i.e. 
when composing or taking a photograph, the photographer sets 
the boundaries or "frame" of the picture. Changing scale and/or 
cropping are the most common methods used in picture editing. 

Changing projection 

The projection plane can be altered through image modification or 
shrinkage. This distons size relationships within the picture and 
affects our perception of image contents. 

Expansion 

Tht use of a filler, such as the addition of a tint block, can alter a 
picture^s height- width relationship. The picture can be venically 
or horizontally stretched. 

Compression 

A picture can be 'compressed", i.e. squashed from the sides or 
top and boUom. 

Deletion 

Distracting or undesirable details in a picture can be removed by 
painting with an appropriate retouching color or shade. This is 
also a way to isolate parts of a picture. 

Cfianges 

Individual picture elements can be changed so as to improve 
contrast, sharpness, grey scale or color scale. The grey scale can 
sometimes be transformed into optional colors. 

Move 

Individual picture elements can be moved within an image for the 
sake of better balance and harmony. It is also possible to move 
pans of the picture to other pictures. 

Turn 

Individual picture elements can be turned and twisted into new 
appropriate positions. 

Supplement 

Letters of the alphabet, numerals, other symbols or markings can 
be added to a picture for the purpose of enhancing image content 
and links to the legend. The super-imposition of text onto a 
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picture image usually impairs our ability to absorb the contents of 
both text and picture. 

Isolation 

An attractive, interesting or amusing detail in a picture can be 
isolated by, say, peeling and cropping. The detail can then be 
used independently or as part of other pictures. 

Combination 

A few thousand '*stock" pictures with standard backgrounds and 
foregrounds, such as landscapes, scenic views, people, 
vegetation, animals, etc. can be combined to form an infinite 
number of compositions. For example, clip art programs are 
available for several personal computers. 

Computerized image processing offers incredible op- 
portunities. However, copyright laws and ethical rules make free 
use of these opportunities impossible. Manipulation or 
counterfeiting of image contents are condemned. In commercial 
situations the contents of a picture may not be changed without 
the expressed consent of the picture's copyright holder. (See 
Pettersson, 1987b, for a discussion of the ethical rules) 
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Entire picture sequences can be stored. This supplies information on "before" 
(picture to the left,) •'now" (picture In the centre) and "after" (picture to the 
right.) 



What happened before and after the displayed picture?Picture 
sequences depicting various events can be stored instead of 
individual pictures. Animation, with the option of freezing each 
component image, could be used. By the use of advanced 
computerized image compression it will also be possible to show 
live sequences. 

Among traditional media this technique is used with great 
success in comic strips. Comics are usually examples of 
presentations where text and pictures are highly integrated. 
Producers of teaching aids and producers of encyclopedias may 
learn a lot from the creation of comic strips. 

Are additional levels possible?The displayed picture is a basic 
picture. It can be stored with several different overlays containing 
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supplementary information in the form of various symbols, such 
as terms in different languages. This gives us an opponunity to 
adapt and structure information by rising above the picture plane. 
In certain instances, the user can also descend below the picture 
plane 




hane 




Example of a basic picture with an overlay ( the words "hane.** "hussvala" and 
"hona" are Swedish for -male,", "house martin," and "female" .) 

Experiences from the use of overhead transparencies may by 
used to guide production of several overlays. 

How can you understand a picture?Pointing at different image 
elements opens one or more windows to other databases with 
information on picture contents. This information may comprise 
explanatory text or additional pictures. Pointing at a word in the 
text opens new windows containing even more detailed 
information etc. Sound can be used in some contexts. In an 
"electronic dictionary," for example, spoken words are displayed 
on the screen. Thus learning is enhanced. Music and sound 
effects can also be used. 
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Examples of windowing. Only the window frames are shown. Here the text is 
only indicated. 

How are text and pictures combined? Use of the windowing 
technique and electronic "clippings" makes it easy to combine 
images and text or parts of texts in the creation of new 
documents. 

Perm et al. (1987) point out that the computer as an aid for 
learning is far from having reached its potential. Its applications in 
education have mainly Heen restricted to the drill-and-practice of 
programmed instruction. KoUerbaur et dl. (1983) developed an 
approach where the computer is an aid or tool for learning. This 
approach is based on cognitive theories for learning, focusing on 
the learner and the learning problem rather than on the 
technology. It was concluded that: 

• the learner should be active and creative 

• the interactive system should be used to solve problems in the 
educational situation and improve learning 

• programs should provide access to the special qualities of the 
computer as a means for handling, communicating and 
presenting information 

• the system should only be used when existing methods and 
other aids are insufficient 

• users (teachers and students) should be able to influence the 
systems, which consequently have to be flexible 

• the systems should be easy to learn and use 

So far computer systems have not been able to fulfil these 
requirements. Most of the options discussed earlier exist already 
today in various systems. Developments are very rapid. New 
products and new systems are released all the time. We can be 
sure that "databases of the future" will offer completely new 
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options of very considerable theoretical interest. A picture printed 
in a book is twodimensional. It has width and height (x and y 
axes.) A time dimension develops when we study a picture. One 
comprehensive study of eye movements (Cf. Pettersson 1986c 
for an overview ) showed that we read pictures in many different 
ways. We also select different picture information in different 
situations (Pettersson 1987a.) The "total teaching aid" and the 
"total encyclopedia" employ some of the best qualities or the 
existing media. Furthermore new qualities are added. As our 
previous examples showed, new dimensions can be added to 
pictures stored in a database. We can attain an expanded time 
dimension by "before-now-after" picture storage. Or we can 
expand to a movement dimension by the use of animation. A 
context dimension is attained by noi cropping too severely and 
retaining elements around the main subject. A picture 
manipulation dimension occurs when we enlarge, shrink, change 
projection, crop or expand, delete, change, move, turn, 
supplement, isolate or combine different image elements in neu^ 
ways. Departure from the picture plane and utilization of overlays 
provide us with a supplementation dimension. We can attain a 
depth-enhancement dimension by employing windows opening 
on other databases. 



Supplementation dimension 




Depth enhancement dimension 



Databases of the future will offer completely new options of very considerable 
theoretical interest. Pictures got new dimensions. 
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Characteristics of visual languages 

• Visual languages have analog coding employing combinations 
of basic graphic elements (dots, lines, areas and volumes) for 
depicting reality (Pettersson, 1983a). 

• Visual languages attempt equivalence with reality. Visuals are 
iconic. They normally resemble the thing they represent. 
Meaning is apparent on a basic level, but the visual language 
must be learned for true comprehension. There are major 
differences between the concepts "seeing," looking" and 
"reading" (Pettersson, 1986a). 

• The propenies of visual elements are rather wide-ranging. For 
example, a dot can vary with respect lo size, shape, color, 
value, grain, position and it its use in a particuhu" context. The 
execution of basic elements is often of vital importance 
(Pettersson, 1983a). 

• Visual languages have varying levels of meaning (Pettersson, 
1983a). 

• Guide-lines and conventions differ. Several variables and a 
structure can be described for visual language (Pettersson, 
1983a). 

• Visual languaging abilities develop prior to, and serve as the 
foundation for, verbal language development (Reynolds- 
Myers, 1985). 

• Development of visual languaging abilities is dependent upon 
learner interaction with objects, images, and body language 
(ReynoMs-Myers, 1985). 

• The level of visual language development is dependent upon 
the richness and diversity of the objecus, images, and body 
language with which the learner interacts and upon the degree 
of interaction (Reynolds-Myers, 1985). 

• The level of visual language development is facilitated by direct 
learner involvement in the procesf. and equipment used lo 
create objects, visual images, and body language (Reynolds- 
Myers, 1985). 

• Picture perception is relative. Different people perceive and 
describe one and the same picture in different ways 
(Pettersson, 1985 & 1986b). 

• Perception of two* or three-dimensional representations entails 
fast, parallel, simultaneus, and holistic processing (Gazzaniga, 
1967, Sperry, 1973 & 1982). 

• It may take only 2-3 seconds to recognize the content in an 
image (Paivio, 1979, Postman, 1979, Pettersson, 983b), but 
20-30 seconds to read a verbal description of the same image 
(Lawson, 1968, Lkwall, i9?7) and 60-90 seconds to read it 
aloud (Sinatra, 1986). In verbal and visual languages prior 
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experience and context are very important to the perception of 
contents. 

• Retrieval from memory involves parallel processing of 
memories (Paivio, 1979, Sinatra, 1986). 

• Memory for pictures is superior to memory for words (Paivio, 
1983). This is called the "pictorial superiority effect." 

• Memory for a picture-word combination is superior to memory 
for words alone or pictures alone (Haber and Myers, 1982). 

• An intended subject/content can be depicted with many 
different pictures (Pettersson, 1986b). 

• Pictures with different executions may still have the same basic 
content (Pettersson, 1986b). 

• Abstract con^^nt is expressed by concrete execution 
(Pettersson, 1985). 

• Concrete content has no abstract execution (Pettersson, 
1986b). 

• Certain basic image elements are more important to the 
perception of the image content than others (Pettersson, 
1986b). 

' Pictures with abstract contents can be perceived in more ways 
than pictures with concrete executions (Pettersson, 1986b). 

• Databases of the future will offer completely new options of 
very considerable theoretical interest. Pictures get new 
dimensions. 



Linguistic combinations 

Different combinations of linguistic expressions are usually 
employed in mass-communications. For example, a text-book or 
newspaper generally utilizes both the printed word and pictures. 
A TV program employs words and images and sounds such as 
music. Interesting effects can be produced by the combination of 
various linguistic expressions, thereby heightening interest and 
attractiveness. We get more interested in the material and pay 
attention to it. The results of several experiments show that 
learning is maximized when the contents of visual, audio and 
print channels are on the same level (cf. Levie and Lentz, 1982, 
for a review). Conveying information through both verbal and 
visual languages makes it possible for learners to alternate 
between functionally independent, though interconnected, and 
complementary cognitive processing systems. The cited 
categories yield 62 v/ays of combining spoken and written 
language, sound effects and music, symbols and pictures when 
producing representations of reality We have no designations for 
most ot these combinations, and the designations we do have are 
often misleading. AV or audio-visual are common designations 
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illustrating the problem. You never know exactly what is meant 
by the term "AV." It may e.g. refer e.g. to the use of slides or to 
slides with audio cassettes. The slides may contain images with 
pictorial content or images with verbal content or both. Braden 
and Beauchamp (1986) make a distinction between '^reader slides*' 
and "picture slides". 



Visual lang^iage 



Audial language 



Verba! langu^e 




Many combinations of linguistic expressions are possible. 

More distinct, specific designations are necessary to any 
serious discussion of linguistic expressions and different kinds of 
representations. There is no practical need for designations 
covering all the combinations possible. However, we should at 
least ' able to distinguish between the categories "spoken 
language" and "written language" in the "verbal languages" 
category. Sound effects and music could be placed under the 
heading "audial language". Symbols and pictures could be re- 
ferred to as "visual languages". This would leave a smaller, more 
easily managed number of combinations. 

Verbal languages 

1 Spoken language or "audial verbal" (or "aural verbal") can be 
designated oral. 

2 Written language or "visual verbal" or "graphic- verbal" may be 
designated as lexigraphic. 

Combinations of these may be referred to as oral- 
lexigraphic. Examples of such representations are texts recited 
in a theatre, radio program or on audio-tape. 

Audial languages 

1 Sound effects 

2 Music 

Both are audial (or aural). Examples may be found in radio 
programs and audio tapes. 
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^^isiial languages 

1 Symbols 

2 Pictures 

Both symbols and pictures arc visuai. Symbols are used 
e.g. for traffic signs. Pictures can be found almost everywhere, 
usually in combination with verbal and/or audial languages. 
Paintings , drawings and other objects of art often stand alone. 
(Paralinguistic visual expressions are not discussed here.) 

Combinations 

Verbal language + audial language can be designated audio- 
verbal. This designation can be used in describing 
representations on radio, audio tapes, records and compact discs. 

Verbal language + visual language can be designated verbo- 
visual and sub-divided into oral-visual (e.g. a filmstrip with a 
spoken commentary) and lexl-visual ( frequently found in 
books, magazines and other printed matter.) The terms 
"lexivisual" and "lexivision" are already being used in Sweden. 

Audial language + visual language can be designated audio- 
visual. Many artistic slide-tape shows and multi-image 
presentations employing images, music and sound effects belong 
to this category. 

Verbal language + audial language + visual language may be 
designated verbo-audio-visual. Motion pictures, television 
and video programs belong to this category. Audio-visual or 
verbo-visual films, TV shows and video programs are also 
possible and sometimes necessary. 
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Current research 



In the information 'society people are being exposed to an 
increasing volume of "messages" from many different senders. 
Tne messages are transmitted from senders to receivers with the 
aid of different media. In all communications (even in mass- 
communications), many individuals are the recipients of the 
messages. 




Many individuals are the recipients of messages from many different senders. 

How do we receive information about the outside world? We 
can smell, taste, feel, listen, see and examine our surroundings. 
We can also ask questions. We ultimately learn to interpret and 
"read" different coded messages, such as those contained in e.g. 
text. 

Here are some examples of current research issues with the 
emphasis on the communications process: 

♦ Interaction of text, pictures and graphical shapes in verbo- 
visual messages. 

♦ Intended vs. perceived content. How should a presentation be 
designed for optimum impact? 

♦ Terminology. 
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• A holistic approach. 

• Information bases on new media. 

• Text and pictures in databases. 

The production of a message commences with an idea 
occurring to someone or with the need to convey information to a 
given target group. When an outline is ready, the generation of 
text, draft sketches, editing, graphical design, the production of 
originals, masicis and, ultimately, a given quantity then begin. 
The sender produces a representation of reality. A representation 
is a medium with specific contents, i.e. a message. Other tasks 
for the sender are stock-keeping, distribution, marketing, 
advertising, selling, billing, bookkeeping etc. 

Here are some examples of current research issues with the 
emphasis on the sender: 

• How are different messages designed? 

• Why are messages designed in different ways? 

• When are different messages designed? 

• The lecturer s perception of her/his lecture. 

A message/content with a given design/form is conveyed by 
the sender to the receiver with the aid of a medium. The various 
media are undergoing comprehensive (technical) changes, 
changes in terms of production, duplication, stock- keeping, 
distribution or presentation of contents. Some of these 
developments are proceeding in the same direction and working 
together. Others are on separate paths. Some are even 
counteracting one another. 





Different media are undergoing comprehensive changes. 

Costs and revenue represent both limitations and 
opportunities. We know that interest in buying and paying for 
entertainment, education, news and factual information varies. 
We also know that the development of systems for e.g. DTP 
(desktop publishing) offer individuals an opportunity to produce 
graphical products at relatively low cost. At the same time, 
facilities are being developed for the production of "distributed 
databases" in the form, of small, compact optical discs with a 
large storage capacity. For example, one CD-ROM can hold 
270,000 A4-sized pages of text. This option makes it possible to 
create completely new types of informational materials in which 
text, pictures, sound and numerical information interact in an 
extremely flexible way. 

Here are some examples of current issues with the emphasis 
on the message: 

• Message/contents - execution/form - medium. Specific 
properties of typical presentations in different media. How do 
they conform with Man's biological prerequisites? 
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• How do we present messages with the aid of different media? 
How can presentations be improved? 

• How should presentations be designed for optimum impact? 

• Description of methods for text and picture analysis. 

• Analysis of structure and variables in visual language. 

• Levels of meaning in visual languages, sub-meanings, 
complete meanings. 

• Use of colors and shapes in symbols and trademarks. 

• The perception of the same message in different media. 

• Design on video display units. 

• Text-picture and picture-text references. 

• Laws and regulations, terms of delivery and ethical norms 
create limitations but even offer some opportunities. 

The receiver's perception of a given message is not likely to 
coincide with the sender's perception of or intention for a given 
message/ content. A number of studies have shown that there is a 
very considerable difference between intended and perceived 
message/ content. In one instance, the differences amounted to 22 
scale (ranging from 0 to 100) was used. 

Medium Execution Receiver Perception 

Medium Execution Receiver Perception 

w Medium jt Execution w Receiver Perception 

Message Medium Execution Receiver Perception 

^ Medium ^ Execution Receiver ^ Perception 

Medium Execution Receiver Perception 

Medium Execution Receiver Perception 

The sender's message and receiver's perception of that message do not 
always coincide. 

We know that both texts and pictures can be interpreted in 
many different ways. As far as information is concerned, text and 
pictures should therefore convey the same message/content so as 
to reduce the number of potential interpretations and increase the 
learning effect. Captions are needed to ''tie down" one of many 
possible interpretations of text. 

Here are some examples of current issues with the emphasis 
on the receiver: 

• Analysis of the receiver's individual perception of variables 
such as pixels/distance/resolution, movement, captions, 
readability, "before and after" etc. 

• The receiver's perception of different presentations, such as 
lectures. 
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• Which factors govern the receiver's interpretation of the 
message? 

• How can we improve coincidence between message intention 
and perception? 

• The receiver's opportunities for interacting with the medium. 

As regards various aspects of verbo-visual messages, efforts 
must be based on a holistic approach with the individual receier at 
the centre. 
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Content 



Before starting designing visuals for instruction it is very 
important to define if, why and how the illustiations can be used. 
The most important factors seem to be informational or 
educational objectives and user characteristics. Visuals may not 
always be really necessary but are useful in many situations. 
However, in some situations pictures may be distracting and not 
supporting the information. In these cases illustrations should not 
be used. 

In the design and production of visuals for instruction or for 
education, pictures must obviously contain the information they 
are intended to convey. The visuals must be relevant tc the 
situation. Without a clear content the visual will not be able to 
function well. 

We should carefully define the objective of each visual. What 
information or knowledge is the visual intended to convey? Who 
is the sender? Who are the receivers? An in which medium or 
media is the visual to be distributed? Cues for understanding the 
message in a visual are different in various cultures as well as in 
different socio-economic groups. It is very important to consider 
this in each specific situation. Messages including visuals are 
preferred by most subjects and attract attention. Generally 
speaking humans, especially their faces, are the kind of content 
that will get maximum attention in images. It is also known that 
objects and pictures of objects are remembered better than their 
names. Adding illustration to textual material may fail to enhance 
attitude change. Results depend on how pictures are executed and 
how they are used. Association is facilitated when items are 
shown together. 




The island Lidc is located south-east of Venice. Lido is long and narrow . The 
island is indeed presented very differently in these maps. As well as other 
pictures, maps must contain the information they are intended to convey. 
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Structure 

A well defined structure of the content facilitates learning. There is 
a need for structure in a complete material as well as within parts 
of that material. Normally the structure of the instructional 
message is built to be continuous, to form a connected whole that 
presents the message clearly to the learners. The instruction pro- 
gresses logically step by step. After an initial orientation or 
instruction instructional materials should develop at a pace that is 
suitable tor the intended audience. A major factor in instructional 
effectiveness is repetition. Also summaries will help learners to 
remember the most important points of the specific subject matter. 
Background colors, shades, shades, frames, and special use of 
fonts and type size can be used to achieve unity. 

When the learner doesn't see, read or hear what s/he expects 
to see, or can't find agreement between verbal and visual content, 
the message is likely to be misunderstood. Since the competition 
for our attention is very hard in commercial arts and in advertising 
discontinuity often used intentionally to attract and even to hold 
attention. The intended message may be hidden within verbal or 
visual puns, metaphors, satires, parodies or humour. In these 
cases designers break the traditional rules of instructional design. 
It might also be possible to use the unexpected to attract attention 
to instructional material as well. 



Realism 

A visual should usually possess a moderate and selected degree of 
realism and be true-to-life. Rather often this means culturally 
accurate detailed drawings in natural color. 

Informative pictures should be "unambiguous", i.e. not too 
"artistic" and therefore ambiguous. Cartoons, line drawings and 
photographs represent a continuum of realism in visuals. 




Cartoons, Ime drawings and photographs represents a continuum of roaiism in 
visuals. 
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amount of learning 



high^^ 



a be 




low 





infinite inf. 



limited inf. 



Low (a), rriGdium (b) and high (c) level objectives demand various degrees 
of realism for high amount of learning. 

The more realistic a visual is the closer it is to reality Too 
little or too much realism in a visual can interfere with the 
communication and learning processes. Addition in stimuli over 
optimum makes it difficult for learners to identify the essential 
learning cues. Learning is always related to the needs of the 
learners and to the level of objectives in each specific situation. 
Low level objectives such as naming of objects need only a 
limited amount of information. High level objectives such as syn- 
thesis and analysis need a lot of information. 



Degree of detail 

A visual should contain the details that are essential in 
communicating the intended message. Too many details and too 
much complexity give rise to distracting "interference" and 
reduces the interest for the content and the impact of the important 
part of the content in the visual. Thus we should avoid 
unnecessary elements in the picture. Too few details and too little 
complexity makes it impossible to understand the picture. For 
each picture there is an optimal degree of details. (This is 
dependmg e.g. on the content, the format, the intended audience 
and the objectives.) 

If necessary, use a series of visuals instead of one visual 
overloaded with information. E.g. in a slide show "one-message 
slides" are usually ideal. This is also true for print material 
designed for children. A depiction of sequence in a series of 
frames should have a reasonable continuity. 
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We are able to perceive up to about seven stimuli at the same 
time. It has been found that 7+/-2 is a reliable measure of human 
capacity in both vision and audition. 

Objects and events perceived as different or as similar in any 
way will be grouped and organized in our perception. Learning is 
facilitated when critical cues are apparent. Avoid non-critical cues 
if possible. 





in 




In AV-productions, it is usually easy to deliver the message step by step. A 
sequence of pictures can aid communication. 









Instructions on how to use chop sticks. The illustrations contain the necessary 
degree of detail. 

Factual content 

In instructional message design the content is very often factual. 
"Realistic" pictures can provide reasonably objective 
documentation of an object or a product 



Objects 

The type of subject should be commonplace, easy to recognize 
and neither uncommon nor abstract. The visuals should not 
contain any strange or unknown codes. The more familiar a 
message is to its audience, the more readily it is perceived. 
Familiarity with the depicted objects themselves is basic to 
understanding. Also the purpose of the visual should be obvious 
to the readers for whom the message is intended. In developing 
countries pictures of people are most easily understood. Parts of 
the body like arms, hands, legs and feet are more difficult to 
recognize. Even more difficult to recognize are tools and objects 
in the environment. People should, however, be dressed 
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appropriately. Facial resemblance to members of the community is 
often an advantage. 

Choice a wide variety of examples as well as non-examples to 
enhance concept learning. In the examples the criterial attributes 
should show as little variation and be as obvious and typical as 
possible. The non-criterial attributes should show much variation 
and be as non obvious and non-typical as possible. 

Objects and pictures of objects are better remembered than 
their names. 

A still picture is a "frozen moment in time". The passage of time is 
best illustrated with a series of illustrations which shows details in 
the course of an event. However, nonliterate people in developing 
countries may have difficulties in understanding that adjacent 
frames e.g. show the same people in a time sequence. 

Picture context and picture composition can illustrate e.g. an 
age, year, season, time of day etc. Enhance comprehension with 
the aid of captions! Sometimes a time-scale may be useful. 

For AV productions it should be remembered that the 
perception of time durations and time intervals is relatively 
inaccurate without a standard or frame of reference. Time that is 
filled with activity appears to pass more rapidly than time that is 
not filled with activity. Time is an essential factor in television and 
film. We can distinguish between objective time (clock time) and 
subjective time (psychological time). 

People seem to prefer programs with fast pace and action. 
Such programs also result in greater learning efficiency. 

Place 

The location of objects may be shown in various kinds of scales, 
graphs and maps. (There is a large literature in cartography and 
the design of maps. However, this topics is not discussed in this 
report.) 



Statistics 

Numeric data are often used to illustrate situations such as 
relationships between variables and parts of a whole. Data can be 
presented in many formats. Graphical formats include 
comparisons of numbers, lengths, areas, volumes, positions and 
also comparisons of different combinations of these. 
Discriminations are most readily learned when the differences 
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between stimuli are maximal. If you wish to be clear, choose clear 
examples. 

It is easier to distinguish between lines than between areas or 
volumes. In most contexts the difference in the sizes of circles, 
squares, triangles, ellipses, and several other two-dimensional 
symbols are underestimated. 

It is easier to assess "parts of a whole" than "relationships 
between variables". When relationships between variables shall be 
presented comparisons of length give the best results. 

Design of graphic elements is important. Patterns should be 
discrete and not disturbing. 

It is far too easy to convey misleading information about statistical 
relationships by using misleading illustrations or scales that are 
difficult to understand. 





/ 


} 












12 3 4 

Comparisons of lengths, areas and volumes. In this example using the units 1, 
2. 3 and 4. It is easier to distinguish between lines than between areas or 
volumes. 
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The three bar graphs in this picture contain the same information, but they give 
us different Imprssions. 



Events 

Several kinds of image contents are related to events. "Action", 
humour, drama, violence etc, time displacement, parallel action, 
metaphoric descriptions (symbolic actions) and change are all 
examples of events that may be the content in visuals. 

It is known that pictures showing events usually are more 
interesting and more effective instructional materials than static 
pictures. Activity is best shown in film or TV-sequences. 
However, also a series of stills may be used. 



Motion 

Obviously several types of content benefit from being shown in 
moving media such as fihn and TV. 

The best way to illustrate motion in a still picture is to depict a 
natural movement in contrast to a static situation. The impression 
of motion can be enhanced with graphical motion symbols such as 
speed lines. The meaning of these symbols has to be learned and 
is easily learned already by young children. 

Motion in a visual attracts attention. The relation of figure to 
ground is particulariy determinative of motion perception, which 
is highly related to depth perception. Perception of motion is 
influenced by contextual variables. 

Rhythm consists of regular changes between different levels 
of a variable. This can be illustrated by arraying image elements 
into distinct groups. 
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Fig. 161 



An illustration from a physical training textbook. The picture illustrates different 
positions. (From Liedbeck, C.H., Gymnastiska dagofningar for folkskolan. 
Stockholm 1891). 



Sound 

The impression of sound in a still picture is most readily conv -ed 
with onomatopoetic combinations of letters combined with 
graphical symbols and legends 




Comic strips enclose the text in different kinds of bubbles. 
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Comic strips often use onomatopoetic symbols for sound. (Beetle Bailey by 
Mort Walker.© King Features Syndicate, Inc). 

In AV productions words and sound-effects can enhance 
perception of the visual stimuli. However, there should be a 
redundant relationship between these different stimuli. 



Humour and satire 

Humour and satire are often used in cartoons to point out a special 
situation, occurence or event. In instructional material humour 
may sometimes be used as a visual pun to attract attention or 
dramatize certain portions of a visual (see also Emphasis). 
However, humour should be used with great care in instructional 
material. Misuse of humour and "funny people" may ruin the 
intended message. This is sometimes referred to as the "vampire- 
effect". 



Relationships 

Visuals may express relationships between people. For example 
in various cultures the distance between people tells the viewer a 
lot about their relationship. 



Emotions 

A picture is able to express emotions in at least three different 
ways. It may suggest an image of some emotional concept, i.e. a 
picture may look the way an emotion feels, e.g. "happy" or "sad". 
A picture may arouse emotional response in a viewer, i.e. the 
viewer may feel pleasure, excitement or fright. A picture may also 
express and reflect the picture creator's feelings about a given 
subject, such as politics or religion. 

Visuals with an emotional content support and extend the 
attitudes we already have. 
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Pictures will usually not change our attitudes but they make 
us more convinced that we akeady hold the "right" views. 

If people like the content in a visual, they like it even more 
when the visual is presented in color and vice versa. 

In the western cultural sphere, people tend to associate colors 
with emotions or moods in the following way. The red and 
yellow part of the spectrum is often said to be warm and is felt to 
be active, exiting, happy and clear. Green to blue are described as 
cold and are perceived as being passive, comfortable, controlled 
and peaceful. 

Emotions and moods are readily conveyed with onomatopoetic 
combinations of graphical symbols^ However, we have to 
remember that the meaning of the symbols must be learned by the 
readers. 



Credibility 

A visual should depict reality in a manner appropriate to the 
content and be as relevant and credible as posblble. If possible use 
familiar pictures. 

High-credibility sources, like television, new film, and radio, 
exert a more persuasive influence than low-credibility sources, 
like newspapers and magazines. However, if attention is assured 
the degree of credibility does not affect the amount learned. 

The most important components of credibility are expertise 
and trustworthiness* The endorsements of real people are 
memorable and persuasive. 

The use of misleading illustrations in comparisons and 
statistics reduces the credibility of the message itself* 

Pictures basically intended for advertisement or propaganda 
are very common in our society* Advertisements always speek in 
favour of someone or something. Propaganda speek against 
someone orsomething. 



Viewer completion 

Our minds constantly fills in missing details and completes 
images, most of the time without our realizing that it has 
happened. The most probable interpretation of the message is 
created as a meaningful whou. However, the human imagination 
may be triggered by the design to provide details that will increase 
viewers attention and possibly also facilitate learning. In drawings 
the lines that are missing may be as important as those that actu- 
ally are there. This is often seen in cartoons. 
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Some lines are more important than others at giving key information. This is 
clearly shown in these examples of squares and cubes. 



Our minds fills in missing details and makes the best possible int'jrpretation of a 
given stimulus. To the left we may see a person whh a hat, not just a few lines. 
To the nght we may see an animal face. 





Execution 



Perception is always organized. We perceptually construct 
relationships, groupings, objects, events, words and people. We 
see dots, lines, areas, light, dark etc. in an organized way. One of 
the most simple perceptual organizations is that of "figure and 
bac'^ground". Some elements in a visual are selected as the figure. 
The remaining elements constitute the background. Our ability to 
distinguish the boundaries of an image is usually very high. 




In these two illustrations, we easily recognize two squares as "figures* agamsi 
the white and also against the dotted background. 




In these two illustrations, the properties of "figure and background" cannot be 
sharply distinguished. Despite our perceptions, the squares are of the same 
size with straight sides. 
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"Gocxi figures", i.e. in the sense of simplicity, regularity and 
stability, are closed and exhibit a continuous contour. A given 
contour can belong only to one of the two areas it encloses and 
shapes". Whichever side, the contour shapes wiii be perceived as 
a figure. 




Nocker's cube, left, can be seen in either of two configurations, those in the 
middle and to the right. 

Reversible figures lack sufficient cues as to which side of a 
contour is figure and which is the background. This is often used 
to create illusions. 




This reversible figure is peceived as a vase or as two heads facing each other. 

In camouflage the intention is to make a figure as much like 
the background as possible. 
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An example of camouflage. Two differently painted models of tanks 
photographed in the same position in a woodland model. Photo by FOA. 
Swedish National Defence Research Institute. 



When lines overlap or compete, emerging figures have good 
continuation. The most symmetrical and simple figures 
constructed will be perceived. 

The simplest image components should be arrayed so that the 
picture's message is brought out as clearly as possible. This can 
be combined with high demands on aesthetic quality, but it is 
difficult to make any general recommendations on how e.g. 
various drawing styles should be used. Fine details in the texture 
of a drawing disappear in the dot screen structure of the printed 
image. Even more detail is lost in a TV image. So making a 
picture which is not tailored to the technical limitations of the 
systems used to make originals, masters and print runs in the 
respective medium/distribution channel is both wasteful and 
unnecessary. 

When visuals are produced for informative purposes, it is 
always a good idea to start by trying to "visualize" the information 
to be conveyed. "Visualizing" a message means that you attempt 
to materialize it in an effective synthesis of words and pictures. 
So visualization is always a composite task, never a single act on 
its own, and requires the collaboration of several different parties. 

The various stages in the production of instructional material 
fixDm visualization to the finished product are listed below. 

A VisuaJzation 

1 Synopsis . Define the message! How can this message be ex- 
pressed? What are the required characteristics and conditions? 
A synopsis should be verbal, take a broad view, be concise 
and to the point. 

2 Idea conception. The idea should be materialized in the form 
of e.g. a sketch. Ideas for the text, sound and visuals are 
conceived. 
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3 Integration. An interplay is organized between the verbal and 
pictorial information. 

4 Graphical design. The layout and any last-minute ideas are 
brought in and a preliminary manuscript is prepared. 

B Making the original 

5 Text. T he manuscript is edited into its final version. 

6 Drawings. Previous sketches serve as the basis for making 
the originals. 

7 Photography . Prints suitable for repro, n*ansparency copies 
or original pictures are produced in accordance with sketches 
made previously or test shots. 

C Making the "master" 

8 Text Technical production. 

9 Drawings. Technical production. 

10 Photography. Technical production. 

1 1 Master". T he text and the visuals are brought together to form 
a "master" which can be used to print a run. 



12 Copies. The specified number of copies are made. In 
principle, the procedure is the same as in the produc- tion of 
graphical products, AV-media, films and TV-programs. 
Sound is an additional repre-sentation in the latter. 



D. 



Run 
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Graphical elements 

Generally, the most simple elements making up a visual are dots, 
lines and areas which can vary in a great many ways. A dot can 
vary in size, shape/color, value and grain. Whether a graphic 
element is defined as a dot or as an area is related to the size and 
the scale of the visual. Obviously the borders between dots, lines 
and areas are not at all very distinct. Three-dimensional visuals 
also have volumes. 




In the left figure, black areas illustrate the track left by the domestic cat. In the 
middle figure, areas with different shading form the track of the marten (Martes 
foina). In the right figure, lines and areas illustrate a track of the arctic fox (Alopex 
lagopus).(AII illustrations from Pettersson, R. & Staav, R., Djurens sp&r. 
SpSrstamplar och spSrtecken. Stockholm 1973.) 



Basic properties of graphic elements . 



Dots 


Lines 


Areas 


Volume 


size 


point of origin 


size 


size 


shape 


length 


'"emptiness" 


shape 


color 


direction 


shape 


color 
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direction 
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A line has one of two functions. It can lead from one place to 
another or it can be a border between two areas. Since we always 
perceive graphical elements wiih respect to the context the 
meaning of a simple and single line will vary. 
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A horizontal line can serve e.g. as a horizon (a), a street (b) or a sea (c). 

Vertical and horizontal lines, parallel to the borders of the 
picture give the impression of calm and stability. Horizontal lines 
give the impression of depth. Vertical lines often stop eye 
movement. Diagonal lines give the impression of movement. 
There is a tendency for curved lines and smooth shapes to stand 
out more than straight lines and shapes made out of straight lines. 
Lines that reach out from one point in different directions may be 
perceived as aggressive or violent 
Tnere are several good reasons for using lines in drawing. 

- Line is the natural way to draw. Infants begin with line and 
adults continue throughout life. 

- Line is a quick way to visualize ideas. 

- Line need a minimum use of time and material. 

- Line drawing materials are least expensive. 

- Line emphasizes the basic structure and composition of a 
drawing. 

- Other drawing techniques may be added. 

- Line drawings are the most readily recognizable form of 
depiction in general. 
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Vertical and horizontal lines (a) are harmonicjs and flat. Diagonal lines dlsr..pt 
harmony and add depth to the visual (b), reaching out from one point they may 
be perceived as violent (c). 



An area may have a geometric, an abstract or a 
representational shape. The size of an individual area is always 
relative. It depends on our knowiodge of its surroundings. 
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The size of a rectangle (a) means little to us. A person standing behind the 
rectangle gives it the size of a desk (b). A car in 'ront of it makQS it the size of a 
building (c). 

A volume has got a three-dimensional form. The form may be 
actual or simulated. In two-dimensional representations of three- 
dimensional objects shadows are the key ques for simulated 
volumes (see light). We structure the three-dimensional field into 
various depth planes, or grounds, a fore-ground, a middle- 
ground and a back-ground. 

In printing technology graphic elements may be defined as 
types for letters and lines and screen points for visuals. In work 
with digital images in computerized image processing, graphic 
elements can be defined in one of two systems. Either 
mathematically as points and vectors^ defined by cartesian 
coordinates, or in the form of pixels (minute rectangular picture 
elements) defined by raster coordinates. 



In image processing graphic elements are defined as points and vectors (a) or 
as pixels (b). 

A vector can be assigned basic graphic properties in the same 
way as attributes in display fountains, but it has as such only 
mathematical properties. A pixel is in fact a minute area and can 



240 



ERIC 



239 



vary with respect to color. Lines, areas and symbols, such as 
letters, are composed of several pixels. 

An area may have a geometric, an abstract or a repre- 
sentational shape denned by the lines or by the dots that form it. 
The size of an individual area is always relative. It depends on our 
knowledge of its surroundings. A square is an example of a static 
area. A rectangle is perceived as more active. A volume has got a 
three-dimensional form. The form may be actual or simulated. In 
two-dimensional representations of three-dimensional objects 
shadows are key ques for simulated volumes (see Light). We 
structure the three-dimensional field into various depth planes, or 
grounds, a foreground, a middleground and a background. 

Study the works of good artists, painters and sculptors. Most 
artists use many of the possibilities in the visual language. 
However, some artists have made paintings, drawings etc. using 
mainly one or two different elements with limited basic 
properties. Here are just a few examples. Vincent van Gogh only 
used dots and lines in some paintings. Paul Cezanne used hues in 
different areas. Pablo Picasso often used areas in different 
shapes. Henry Moore is a master of lines and volumes in his 
sculptures. 

The most important elements of the visual may be emphasized 
as to enhance attention and perception (see "Emphasis"). Design 
visual material taking into account dots, lines and areas so that the 
important content will stand out and be easy to perceive. 



Type of visual 

Look around! In your home, at work and in other places you will 
see that there are many different types of visuals. You may see 
drawings, paintings, collages, montages, mosaics, maps, pictures 
or textiles, lithographs, photographs, pictures in books, 
magazines, newspapers and television. The visual register is very 
large and we see a good deal of it every day. Visuals showing the 
same subject can be executed in many different ways. 

Preference for a particular visual format does not necessarily 
result in increased learning. Yet, in the absence of more 
substantial data, information based on student preference has a 
meaningful role to play in affecting learning from instructional 
texts. All other things being equal, we should provide formats 
which are preferred by the viewer, thus making the text more 
attractive, and hopefully more motivating. 

Visuals for instruction should be attractive but 
"unambiguous", i.e. not too "artistic" and therefore ambiguous. 
Visuals that are attractive and that people like also have greater 
impact. 
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Generally speaking it is not possible to rank the different 
types of visuals. Often the type of visual which should be used 
must be determined in each individual case with a view to various 
demands on the picture and the prevailing budget framework. It is 
often easier to control the production of a drawing than the 
production of a photograph. So a drawing may be the only 
realistic alternative in many instances. 



Subject 

A subject may be presented in several different ways. The part of 
the subject that is important to the subject must be large and clear, 
take up a large proportion of the image area and be perceivable as 
an entirety. Symbolic illustrations are easier to do but they may be 
more difficult to recognize. 

For children up to the age of about seven years, the entire 
subject must be clearly visible. No important part of the subject 
must be hidden in or missing from the visual. Absent items do not 
really exist, in the minds of many children. To a large extent this 
is also true for nonliterate adults in developing countries. The 
"personal space" between people in a visual is important with dif- 
ferent meaning to readers belonging to different cultures. 



Light 

The word photography has its origin in greek and means 
"writhing with light". Drawers as well as painters and 
photograpers make use of various lighting conditions, light, 
shadows and darkness to create perceptions of volume in 
twodimensional pictures. A person or an object depicted in hard 
or soft light ^Adll be perceived differently. 

The physicist define light as visible radiant energy. Actually, 
light is invisible. We can see it only at its source and when 
reflected. Light has outer as well as inner orientation function. 
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Examples of different lighting conditions. 
Outer orientation functions 

Light will articulate our outer orientation with respect to space, 
texture and time. Without any shadows we can make out the basic 
contour of an object. Shadows define space. The attached shadow 
is on the actual object. It helps to reveal the basic form and 
dimensions of that object 

ITie cast shadow is frequently observed as being independent 
of the object that caused it. Depending on the angle of the light 
source the cast shadow may reveal the basic shape and location of 
the object that caused it. The surface appears to be curved when 
the light falls off gradually. A highly directional (hard) light 
produces fast fall-off. Thus a curved surface is emphazised. A 
highly diffused and nondirectional (soft) light produces slow fall- 
out. Prominent cast shadows caused by hard light from a low 
angle emphasize texture. Soft light, on the other hand, de- 
emphasize texture. Thus both hard and soft light may be used 
successfully for spatial and tactile orientation, for example in 
portrait photography. In daylight the background is usually 
bright. The castshadows are vei*j pronounced and the fall-off if 
fast. In a night time scene the ^ackgiound is dark. The lighting 
from various lightsources is highly .^elective. Shadows are v^xy 
prOiTiinent. 



Inner orientation functions 

As well as light can articulate space, texture and time it can also 
articulate inner orientation functions. In motion picture and TV- 
production light, especially combined with music and sound 
effects, can evoke a great variety of specific feelings and emotions 
within us. Already minor position changes of principle light 
sources may have drastic effects on our perception oi mood and 
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atmosphere. For example a face lighted from below may appear 
unusual, ghostly and brutal. 



Lighting 

The two basic ways of external lighting are chiaroscuro and 
Notan lighting. The light-dark chiaroscuro method means lighting 
for volume and emphasizing of three-dimensional qualities. The 
lighting is specific and hits only parts of the scene. The overall 
illumination is low-key with high-contrast lighting on figures, 
persons and objects. The background is usually dark. The 
shadows are prominent with fast fall-offs. Notan lighting is flat, 
for simple visibility. The light comes from no specific direction 
and it is nonselective. Shadows have extremely slow fall-offs. 
The images have extremely lovv contrast and the background is 
usually light. 



Shape 

External shape 

The picture area in drawing, painting and still photography can 
have any shape and orientation. Still most pictures are cropped 
and published in square or rectangular formats. However, the 
visual's external shape should be "free-form", round or oval and 
not delineated by straight lines. Perception of shape is influenced 
by contextual variables. 

Television as well as film screens are horizontally oriented, 
since we basically experience the world on a horizontal, rather 
than a vertical plane. Note that different shapes are visually 
assessed to be of different sizes, (see Size). 



External contour 

The visual's external contour should be blurred and unclear so the 
visual fades in/out of the background and never clear enough to 
stand out against the background. It is possible that very distinct 
framing diverts interest from the actual content in the visuals. 

Illustrations in early European books frequently had gently 
rounded contours. Many artists still frequently draw free-form 
visuals which are not delineated by straight lines and which fade 
in/out of the background. 

In one study typical primary school textbooks from Ghana, 
Japan and Sweden were compared. Irregularly shaped, oval, or 
round image shapes were predominant in the Ghanian and 
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Japanese books. In the Swedish book fewer than one-fourth of 
the illustrations were "free" or rounded images. 



Size 

It is easier for us to distinguish between lines than between areas 
or volumes. When we judge the size of objects, e.g. areas, we are 
apparently most influenced by the length of horizontal lines or 
horizontal distances (See also Comparisons and statistics.) In 
most contexts the differences in the sizes of circles, squares, 
triangles, ellipses and other two-dimensional symbols are 
underestimated . 




smallest worst 

Children's assessm9nt of visuals with equal areas, to the left andchildren's 
preferences of image shapes, to the right. (From Rune Pettersson, Bilder barn 
cch massmedia. Stockholm 1981.) 



Size of visual 

A visual should neither be too small nor too large.However, the 
size must be large enough for the image to be legible. A visual 
with a "large content" and many details must be larger than a 
visual containing a more limited amount of information. If one 
picture is larger than the others in an array this picture will attract 
the most attention. "Noise" in the visual results in a need for a 
larger size. A picture 4 - 5 cm (1 1/2 to 2 inch.) wide in a book 
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corresponds to the eye's perception of the width of a TV screen at 
a normal viewing distance and is adequate in some cases. In TV 
the spectacle of things is de-emphasized but human actions gain 
prominence. A large cinemascope image is more o- erpowering 
than the small TV image. In film people as well as things attain 
spectacular dimensions, 
legibility 




size of visual 

The size of a visual should be large enough for tho image to be legible. There is 
an optimum size for each visual. 



Size of subjects 

The part of the subject, important to the subject, must be large and 
clear, take up a large proportion of the image area and be 
perceivable as an entirety. Large visual elements attract the 
attention of the reader. 

The perception of size is influenced by contextual variables.lt 
is usually a good idea to include some familiar object to supply 
the scale forjudging the size of an unfamiliar object. 

People vary greatly in their ability to perceive proportional 
relationships. TTie perceived size of an object is relative to the size 
of other objects. The size of unfamiliar objects are perceived as 
relative to the size of familiar objects. Sometimes it is possible to 
include a scale in the visual. 

Any simple and distinct part of an image can be visually 
superimposed to measure proportional relationships of the whole. 
In caricatures, however, proportions are deliberately wrong. 

When the size of an object changes in a story from one page 
to another or even on the same page, children up to seven years of 
age often believe that the objects are different. 
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The perceived size of an object is relative to the size of nearby objects. Above, 
the letter *a* is equal in both contexts, so is the dark drcle in the other pair. 




In caricatures, deliberate distortions create aesthetic tension between the 
caricature and the normal image of the subject. This induces emotional 
responses in viewers. Feelings are readily aroused by a departure from what is 
considered visually correct or normal. Photographers can also produce 
"caricatures" by using unusual angles and/or distorting lenses* When we need 
visuals for instruction, caricatures are usually not the best choice. This 
caricature was produced and published to illustrate opposition to the theories 
about evolution published by Charles Darwin in his work "On the Origin of 
Species by means of Natural Selection". 
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Size and depth 

The perception of size is related to perceived diijtance and the 
perception of distance is reciprocally related to perceived size. 
Regardless of distance there is a constancy in the perception of the 
size of known objects. 



Color 

A visual should usually be in color but not in unrealistic colors. It 
is possible for us to see the difference between several million 
colors. However, we can only distinguish about 10,000 different 
colors. 

Yellow-green (about 555 millimicrons) lies in the region of 
the eye's greatest sensitivity. Sensitivity decreases markedly 
toward the red and blue ends of the spectrum. Perception of color 
is strongly influenced by and dependent on contextual variables 
such as lighting conditions and other, surrounding colors. 

Color constancy is tendency to judge surface colors as the 
same despite changes in illumination. 

People in different cultures and in different socio-economic 
groups use colors in different ways and with different meanings. 

cultures in Africa, Central and South America and Indonesia 
bnght colors and high contrast are common in illustrations. 



Color preferences 

People prefer surface colors according to this ranking: 1 blue, 2 
red, 3 green, 4 violet, 5 orange and 6 yellow. 

Children prefer colors that are light, distinct and shining 
better than colors that are dark and gloomy . Color intensity 
should be strong and color contrast should be clear. 

Color visibility 

When colors of equal intensity are compared the most visible 
colors are: 

1, white 2, yellow and 3, green in that order. The least visible 
colors are 4, red, 5,blue and 6, violet 

The most legible combinations of print colors is black or dark 
brown text on a light yellow background. Other combinations 
may attract more attention but are less legible and, thus, require 
bigger letters. (See also Legends.) For color visibility on TV 
screens, see table. 
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Judged perceived reading efforts, mean values. 40 subjects (high values = good 
combinations, low values = bad combinations). 
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Calculated NCS-values: 1200 (white), 5000 (grey), 8500 (black), 6040-Y50R 
(Brown), 1060-Y (yellow), 1070-Y50R (yellow-red), 1080-R (red). 2560-R50B 
(red-blue), 2070-B (blue), 1570-B50G (blue-green) 1070-G (green), and 1070- 
G (green), and 1070-G50Y (green-yellow). 



Attentional use of color 

Colors are good aids in drawing attention to certain cir- 
cumstances. It is hard to recognize an image when it has many 
colors. It has been found that even if color is not adding any 
information it is still contributing to a better learning because the 
interest for the picture increases. There are many ways to use 
colors to get attention to a certain information. 



Affective use of color 

Color enhances the perception of a visual message. If people like 
the content in a picture they like it even more when the visual is 
presented in color and vice versa. Sometimes color enhances 
learning but in many cases black and white would be better. 
However, from many experiments it is quite clear that people 
usually prefer color in visuals. Advertising is known to be much 
more effective when visuals are in color than in black and white. 

Tests have indicated that viewers feel they have a better 
understanding when TV images are displayed in color, although 
the use of black and white sometimes would be sufficient. 



ERIC 



243. 



249 



However, an improper use of color can produce negative results. 
It can be distracting, fatiguing and upsetting. 



Cognitive use of color 

Color is important in a visual when it carries information that is 
vital for the content in the visual. It is for example easier to learn 
to distinguish between various species of birds or butterflies 
when color illustrations are used instead of black and white. It is 
known that highlighted mformation tend to be better remembered. 
Colors can easily t)e used for highlighting. In line drawings or in 
black and white photos for example the addition of one color may 
be very efficient. To avoid confusion and misunderstanding it is 
very important that color is used consistently. 



Color coding 

Colors are often used for color coding, for example of ob- 
jects.This is used also in different signs and symbols. The 
number of color codes should be very limited. As the number of 
color coded items increase, the value of color as a cue for 
selecting important information decreases. In videotex for 
example subjects tend to dislike the use of more than four or five 
colors at the same time. 



Decorative use of color 

There are many situations where colors can be used for 
decoration. However, a decorative use of color should never be 
mixed with other uses of color. It must always be easy to 
understand when color is used for decoration and when the use is 
cognitive. 



Color psychology 

In spite of the large quantity of research, color perception still 
only seem to be partially understood. It could be concluded that: 
' The human reactions to color stimuli cannot be standardized. 

Depending on sex, age and culture, the subjective reactions to 

color are different. People might see colors in the same way. 

However no two persons experience color in precisely the 

same way. 

• There are likes and dislikes of color, based on general and 
personal associations. 

• Everywhere we find user expectancy to the use of color and 
their meaning. 
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Contrast 

The contrast i.e. the difference between the brightest and the 
du ^mest parts of a visual should be clear. This is regardless of the 
color chosen and color-contrast effects. It >s known that high 
contrast between objects attract attention. Children prefer "light" 
visuals as compared to dark visuals in relation to whiteness- 
blackness i.e. the grey scale. In the comparison of the darkness of 
tones on a graphic display, differences in tones will be overesti- 
mated. 

It is far *o common that illustrations e.g. in textbooks does 
not have good contrast. Instead, it is often a more or less even 
shade of grey. 



Emphasis 

Emphasis is used to attract or direct attention or dramatize certain 
points of a visual. A dark dot in a light field or a jog in a line are 
examples of emphasis. The contrast of the dark area against the 
light background draws attention to the dot. The more dots the 
less the degree of contrast and *he less effective the emphasis. 
Many dots form a pattern of light and dark areas which compete 
with each other. Neither shade dominates or demands mere 
attention. The more competition for attention the less effective is 
the emphasis. Many different elements in a visual can cause 
emphasis. Light against dark, color against no color, detail 
against no detail, change in size, arrows, implied motion, circles 
or ovals around objects, stars, shaded areas, line drawings in 
photos, words, position or placement of elements, line 
intersections, or any other unexpected change or variation out of 
context will create emphasis. (See also "Symbols..."). 
Evermore emphasis on the message is achieved by reducing the 
number of details in the picture to those who are really essential. 



Composition 

Composition is discussed here mainly within the individual 
visual. (Also see "Context".) 



Organization 

The elements in a visual may be arranged in a pattern that is easy 
for the reader to comprehend. Organization provide a pattern that 
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facilitates learning. By organizing the graphic elements it is 
possible to direct the eye movements within the picture. 

Perceptually, we group things on the basis of similanty and 
distinguish between things on the basis of disparity. Certain 
stimuli, such as contour-lines, unusual colors or graphical 
symbols, are accentuated in perception while others, such as 
uniform areas, are not. 

Horizontal and vertical lines are more intense than other lines, 
i.e. they evoke more mental activity and they are more easily 
compared. Organizing a message can make perception much 
easier and learning more efficient. The visual should have a 
moderate degree of complexity. Complexity without order 
produces confusion and order without complexity produces 
boredom. Differences in texture and grain may help organizing 
information. 

Direction, position and orientation of objects are essential 
parts in organizing the information. Many confusing results may 
occur if used improper. 

The more informative parts of a visual attract more eye 
fixations than the less informative parts. 



Centres of interest 

The visual should only have a few centres of interest, preferably 
only one at or near the visual's optical centre, i.e. just above and 
to the left of its metric centre or otherwise in the upper third of 
the visual. Thus the visual has unity. The most important 
elements of the visual may be emphasized to enhance perception. 

Young children may chose to pay attention either to the whole 
picture or to specific parts of it. For children until about nine 
years of age it might be difficult to switch attention between a part 
and the whole. 
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In the U.S. viewers tend to begin looking at a visual from the left side, 
particularly the upper left portion. The optical centre is above and to the left of 
the geometrical centre. 
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In one experiment adult subjects looked at a drawing of two flying House 
Martins. The distribution of fixations within different parts of the image area is 
shown in this figure. More than half of the 215 fixations made by the seventeen 
subjects were in the central field. 

According to the "rule of thirds" the cen»^e of interest may be 
selected at any one of the four points wheiw equidistant vertical 
and horizontal lines divide a picture in three parts. 
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Centres of interest according to Ihe rule of thirds". 



Balance 

A visual should display the best possible balance. Elements of the 
visual should fit together in a harmonious relationship in a manner 
which is interesting but not distracting. 

Imbalance creates an uncomfortable feeling in the reader and 
should be avoided. 

Balance could be forn?al with total symmetry or informal. 
Formal balance is felt to be static. Informal balance contributes to 
a feeling of dynamism. 
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Perspective 

Spatiai perception is not the perception of space as such but of the 
learned meaning of the relationship between different objects seen 
in space. 




We see this pattern (left) as a black disc partially occluded by a white disc (the 
natural way of things). However, the figure may actually represent an 
incomplete black disc nestled against the white disc, as demonstrated to the 
right (the discs now separated). 

We have to distinguish between an optical and a perceptual 
reality. Optical reality is only governed by geometry and is only 
visual. Ho'vever, perceptual reality is governed by object 
constancy and combines what we already know about the subject 
with what we can see, hear, smell etc. Central perspective is the 
graphic equivalent of optical reality and is a rather recent 
perceptual acquisition developed in the early Renaissance by 
artists who learned to see form and space in a new way. 

In central perspective all perspective lines converge toward 
common vanishing points. The accurate proportion is established 
by oi\r intuitive experience. People in some cultures do not see 
our central perspectives. An orthographic projection is the graphic 
equivalent of our perceptual reality. A mechanical orthographic 
drawing shows proportions exactiy. 



Depth 

The perception of depth is related to the relative size of known 
objects, to illumination and shadows, judicious croppings, linear 
perspective, texture gradients, upward angular location of 
grounded objects, overlap inter-position and filled space. Image 
elements conveying a sense of depth should be clear and easy to 
comprehend. 

A visual must not incorporate any built-in f Acdl illusions or 
geometric patterns making it possible to interpret the image in 
different ways. 

In the new visual communication media, like video games 
and computerized pictures the use of depth composition is 
common. The combination of rapid inward-outward movement, 
disiorted depth of field, and forceful direction of visual elements 
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placed on the Z-axis disturbs viewer comprehension and 
diminishes the aesthetic appreciation of such images. 

Visuals in some books for children have differing perspec- 
tives ?.t the same time, making it quite confusing for the readers. 



Depth of field 

Photographs often have well defined foregrounds and 
backgrounds and parts in between. During photography the depth 
of field is influenced by the distance to the object and the camera 
aperture. The depth of field can vary from several meters to a few 
decimeters. 

By making the foreground sharp and background blurred 
interest is directed to the foreground and vice versa Obviously, it 
is also possible for an artist to choose depth of field in her or his 
drawing. 

Uneasy backgrounds should be avoided in visuals for in- 
struction. Instead balance and harmony should be present in any 
picture. Very often it could be recommended to move in closer on 
the object and thus avoid uneasy components in the background. 



Picture angle 

A picture angle corresponding to the angle of normal vision is 
preferable to wide-angle or telescopic views. However, 
regardless of the uigle there is a constancy in the perception of 
known objects . 




Regardless of the angle (in this example a, b and c) there is a constancy in the 
perceptior^ of known objects. 

Picture height 

A frontal projection in which the subject is rendered from normal 
eyelevel is easier to comprehend than other projections and 
angles. 
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Technical quality 

Obviously the technical quality of a visual should be "good" and 
tailored to the medium. A printed picture should be matt and 
distinct, not blurred overly glossy or dazzling. Resolution should 
be sufficient for the reproduction of the desired details. 
Remember that fine details in the texture of a visual disappear in 
the dot screen structure of the printed image. Even more detail is 
lost in a TV image. Poor technical quality is far too common in 
instructional message design. The result of most of the previous 
work on visualization and making originals can easily be 
destroyed by a single error in the making of the master or in the 
actual production of the copies. Negative text in color is often 
hand to read due to misalignments in printing. 



Symbols and explanatory words, lettering 
Explanatory words, numbers or other symbols should be 
incorporated into the picture as reading aids when this facilitates 
comprehension and learning. These aids must not then be 
distracting, large nor ugly. Simple styles and fonts are more 
easily read than complex ones. 

Relationships, moods, sound and movements can be con- 
veyed in a picture with the aid of signs and symbols. However, 
symbols have to be learned by the readers. Usually they are not 
naturally understood. Especially in developirig countries symbols 
must be introduced slowly and patiently. 

Symbols are of special value and importance in maps. 

In audio-visual materials, such as slides and filmstrips, and 
screen presentations, lettering must be considered carefully. 
Fifteen to twenty words on a slide are maximum for effective 
comrnunication. Letters should be medium to medium-bold. 
Lettering height should be po less than one twenty-fifth the height 
of the artwork to oe transferred. Generally speaking lower-case 
letters are more legible than capitals. 

Symbols of various kinds may be used for emphasis. (See 
"Emphasis"). 



256 




o 



Mixing and zoom 

Film and TV-production is not discussed in this book. However, 
even in print media, especially in comics, the use of sequences of 
pictures often remind of film and television. Comics might in fact 
be called "graphic films". Content is added to content frame by 
frame. It is possible to "cut" between scenes and zoom in and out 
to direct attention. 

Picture editing 

Modem computerbased graphical systems for picture handling 
have great built in possibilities for editing of the content. 

Selection 

Every published visual has been selected, not only once but 
several times. First the picture creator, the photographer and/or 
the artist, makes a selection of tiie subject matter. In any given 
situation a lot of different pictures may be produced. Then the 
editor makes a selection among various pictures in a collection or 
in an archive. Usually several sketches or outiines makes a basis 
for decisions necessary in tiie production of the final drawings. A 
selected photo often need cropping. By cropping distracting 
and/or uninteresting parts of tiie image are eliminated. 



Changes of image content 

The content of an image can be changed in seveial ways. We can 
change tiie scale, change projection, crop or expa! ', reduce, 
delete, modify, move, turn, supplement, isolate or combine 
various image elements . Pictures can be stored as object oriented 
descriptions, in bit-mapped form or as a combination of same 

Scale Ail image may be scaled up or down. The content remain 
ihe same but the chosen scale can influence our perception of it.If 
the plane of projection is changed tiie relations between various 
parts in the picture will be influenced. 

Cropping. An original picture can often be improved by removal 
of irrelevant or distracting elements. Pictures can be cropped from 
all sides. The photographer always performs some initial 
cropping, i.e. when composing or taking a photograph, the 
photographer sets the boundaries or "frame" of the picture. 
Changing scale and/or cropping are the most common methods 
used in picture editing. 
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Changing projection. The projection plane can be altered through 
image modification or shrinkage. This distorts size relationships 
within the picture and affects our perception of image contents. 

Expansion. The use of a filler, such as the addition of a tint 
block, can alter a picture*s height-width relationship. The picture 
can be vertically or horizontally stretched. 

Compression. A picture can be "compressed", i.e. squashed from 
the sides or top and bottom. 

Deletion. Distracting or undesirable details in a picture can be re- 
moved by painting with an appropriate retouching color or shade. 
This is also a way to isolate parts of a picture. 

Changes. Individual picture elements can be changed so as to im- 
prove contrast, acuity, sharpness, grey scale or color scale. The 
grey scale can sometimes be transformed into optional colors. 

Addition The relation between width and height of the image can 
be changed by the addition of space. To achieve emphasis it is 
common to add information such as shadows, contrasts, colors, 
signs and symbols. 

Move. Individual picture elements can be moved within an image 
for the sake of better balance and harmony. It is also possible to 
move parts of the picture to other pictures. 

Turn. Individual picture elements can be turned and twisted into 
new appropriate positions. 

Supplement. Letters of the alphabet, numerals, other symbols or 
markings can be added to a picture for the purpose of enhancing 
image content and links to the legend. The super-imposition uf 
text onto a picture image usually impairs our ability to absorb the 
contents of both text and picture. 

Isolation. An attractive, interesting or amusing detail in a picture 
can be isolated by, say, peeling and cropping. The detail can then 
be used independently or as part of other pictures. 

Combination. A few thousand "stock" pictures with standard 
backgrounds and foregrounds, such as landscapes, scenic views, 
people, vegetation, animals, etc. can be combined to form an 
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infinite number of compositions. For example, clip art programs 
are available for several personal computers. 

The picture in context 

Pictures should always be adjusted to fit into their final context 
(see Context). 

Image framing makes a clear distinction between image and 
background (see Image framing). 

Fading is used to have the image gradually appear on the page 
(see Shape). 

Layout is the integration of text and images, i.e. on an 
opening in a book (see Layout). 

Legends give the reader necessary guidance in understanding 
the image content (see Interplay of words and visuals). 



Copyright 

The rights of copyright holders are protected according to 
international conventions. In Sweden, for example, a 
photographer enjoys sole rights to a picture for 25 yeai: after a 
picture's production. However, pictures with artistic or scientific 
merit enjoy protection for fifty years after the death of the 
copyright holder. Drawings belong to this category. In practice, 
almost all photographers can be said to have some '"artistic merit". 

When photographs are produced on commission, the client 
usually enjoys all copyright rights, including rights to prints made 
from originals. The client can freely utilize the commissioned 
pictures in any way desired. 

Publishing rights to archive photographs are usually bought 
for each publishing occasion. The buyer may not then transfer 
publishing rghts without written permission. 

As regards drawn illustrations, the client usually pays for the 
actual sketching/ drawing work, originals and reproduction rights 
for a particular application.The physical drawings, i.e. the 
originals, usually remain the artist's property. Thus, the client 
becomes entitled to compensation, equivalent to the "re- 
acquisition cost," if an original should be damaged. Unless 
contractually forbidden, the artist has the right to use a commis- 
sioned illustration in other contexts. In contrast to the position for 
the photographers, artists are unable to sell artistic rights to 
pictures. 

The name of the picture creator or copyright holder must be 
stated in each printed document containing the pictures, preferably 
in direct conjunction with the pictures. 



253 



259 



After 1st January 1979, no person's name or picture nnay be 
used in Swedish advertising without permission. 

The development of new technology and new media will 
result in some infringement of existing legislation. A Swedish 
committee has been conducting a "Copyright Study" since 1976. 
The Study is examining tJi'^ problems related to copyright rules. 
The Study's directives specified e.g.: "A main task for the Study 
is to establish a reasonable balance between the copyright holder's 
wish to maintain control over her/his work and the public need to 
utilize this work without needless obstacles. However, the object 
is not to convey impropci benefit to people who make commercial 
use of work under copyright at the expense of the originator. Nor 
may the artistic rights enjoyed by originators, according to 
existing legislation, be compromised. "No completely new law is 
likely to be passed in Sweden before the end of the 1980's. 
However, existing laws may be amended from time to time. 
Following a legislative change which came into effect on 1st July 
1982, Swedish penalties for copyright infringement were 
increased. Thus, the penalties for "picture plagiarism", deliberate 
or in consequence of gross negligence, are now a fine or prison 
for up to two years, i.e. a quadrupling of the previous penalty. 



Terms of delivery 

Many photographers, most picture agencies and newspaper 
archives and some museums are members of the Swedish 
Association of Picture Suppliers (BLF). This organization 
promotes the interest of picture copyright holders. Its detailed 
terms of delivery reject every kind of manipulation of picture 
contents. They note e.g. (p.7 and p.l7):"A picture may not be 
manipulated, without the photographer's/ seller's specific 
consent, by electronic or other means. 

"Nor may the picture nor any part thereof be combined, 
without said consent, with any other picture so the two pictures 
appear to be a single work. 

"A charge of at least SEK 5000 will be levied for each such 
infringement of this ban on manipulation. 

"If infringement is deemed offensive to any individual party, 
legal redress may be sought to the Penal Code." 

Nordic Artists (NT) is a joint body for artists' and graphical 
design organizations in Denmark, Finland, Iceland, Norway and 
Sweden* It promotes the interests of artists and has drawn up 
common terms of delivery. They specify (point 3), among other 
things: "No changes nor any other kind of image processing may 
be performed without the express consent of the originator." 
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Thus the contents of a picture may not be changed without the 
express consent of the picture's copyright holder. 



Ethical rules 

Ethical rules, drawn up by the Swedish Newspapermen's 
Professional Association (PK), the Swedish Journalists' Union 
(SJF), the Swedish Newspaper Publishers' Association (TU) and 
Swedish Broadcasting Corporation (SR) are available for the 
press, radio and TV, The object of these rules is to provide the 
individual members of the public with protection over and above 
that laid down in law. The rules instruct newspapers to avoid 
publication of information on a person's private life unless that 
information is of indisputable public interest. These ethical rules 
condemn manipulation or counterfeiting of picture contents by 
cropping, montage or misleading captions. Non-authentic pictures 
may not be published as authentic, genuine material. The 
"Ground Rules for Press, Radio and TV" published by the Joint 
Press Council also point out that people who buy pictures are 
responsible for ensuring that the pictures are not misused. 

A person who feels that she/he has been poorly treated or 
erroneously described in a newspaper article has the right to 
demand a correction from the magazine or newspaper. She/he 
may also turn to the Press Ombudsman of the General Public 
(AO). This officer will assist the plaintiff by getting in touch with 
the newspaper in question, procuring a correction or retraction or 
having the matter brought before the Swedish Fxess Council 
(PO), an unofficial "court" on ethical matters. If the PO feels that 
criticism of a newspaper or magazine is warranted, the newspaper 
or magazine is obligated to print the PO's verdict. This verdict is 
often printed in other newspapers such as the Journalist (SJF) and 
the Press Journal (TU). ITie criticized magazine/newspaper must 
also pay a service charge. 
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Context 



The context in which a visual message is presented has a major 
impact on the way the message is perceived. 



The same pattern is identified as "B" in the first sequence (a) and as "13" In the 
second sequenro (D). 

For example, the context may consist of text, speech, music, 
sound effects or other visuals. Our attention is on either the sound 
or the image when we view a film or a TV-program. This is even 
more obvious when we look at a multi image slide-and film 
presentation. As soon as the film starts our attention is directed 
towards the movement in the film from the surrounding stills. It is 
just impossible for viewers not to be influenced by the film. 

Indirect contexts are the medium in which the visual is 
presented, the receiver of the message, the society and the culture. 
Our perception of a stimulus is thus not only determined by the 
characteristics of the main stimulus but also by those of the 
context. This is however, not the case with young children. A 
background which might give extra information to an adult cannot 
be assumed lo fulfil the same function for a child. 

Perception of brightness, color, size, shape, pattern, and 
motion have all been shown to be influenced by contextual 
variables one and the same visual can be perceived in different 
ways in different contexts. A single picture taken from a series of 
pictures may be hard to decipher but the visual's content becomes 
easier to comprehend when that picture is returned to its proper 
sequential context. 

A background which might give extra information to an adult 
loader cannot be assumed to fulfil the same function for a child. It 
may actrnlly hinder the child from perceiving the picture at all. 
Thus w ould be very careful in selecting context for our 
messag( 



Interplay of words and visuals 

As seen earlier pictures may have various functions for 
example, pictures are very good at conveying informaiiun about 
what objects really look like. Text however, is very good to use 
when e.g. logical relations shall be expressed.Visuals used to be a 
kind of special features in books and still are in far too many 
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situations. The illustrations in the laboriously copied books from 
the Middle Ages are often compared to paintings in a museum or 
windows in a church. The illustrations in the manuscripts even 
had frames of genuine gold in many cases. For hundreds of 
years, visuals often remained extra features with a rather limited 
connection to the text. In the last century, textbook visuals were 
often placed vertically to provide better use of page space or an 
already existing illustration, e.g. a wood-cut was sometimes 
used. Visuals were often a kind of "painting" with little or no 
interaction with the text. However, visuals have been used in a 
more practical way in non-fiction books. As early as the Middle 
Ages, some secular texts were illustrated. 

Medical science demanded a knowledge of herbs. In copies 
of the Greek Herbal of Pseudo-Apuleius, the illustrations were 
originally intended to help the reader identify the plants. Each 
illustration had a text under it giving the characteristics of the herb 
and its medical use. 

However, copies made from earlier manuscripts, rather than 
from living plants, ultimately transformed the illustrations into 
stylized forais very d '%ent from botanical reality. 

In ancient Egypt several gods were worshipped, people 
houed to live for ever but also after death several fears remained. 
To be able to enter the kingdom of the dead the dead person had 
to know the correct formulas. Except food, drink and clothing the 
dead person also had to bring a "Book of the Dead", a papyrus, in 
the tomb. Already from 2000 BC these books were sold to rich 
people. A "Book of the Dead" contains descriptions of the travel 
in the underground, prayers and formulas, expressed in words 
and visuals. These were tfie first "inforaiative lay-outs". 
In more modem time, the first one to really show how visuals and 
words could interplay was Johannes Amos Comenius of Moravia 
(today a part of Czechoslovakia) from the middle of the 
seventeenth century. His findings were more or less forgotten and 
"reinvented" only recently. Today, words and text usually interact 
nicely with visuals in instructional message designs. 
Substantial research has clearly shown that learning efficiency is 
much enhanced when words and visuals interact and supply 
redundant information. The improvement sometimes exceeds 
sixty percent and averages thirty percent. 



Text 

The text should be readable, legible and well worth reading. 

Readability in this context can be defined as the degree of 
linguistic difficulty, i.e. the sum of the linguistic properties of a 
text which make it more or less accessible to the reader. 
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The two factors which best designate the linguistic com- 
prehensibility of a text are sentence length and the proportion of 
long words. An easily comprehensible text is characterized by 
short sentences, short words and simple sentence structure. Other 
variabJ'^s which affect the comprehen* Mlity of text are the 
vocabulary's degree of abstraction, the number of syllables in 
wonis, the commonness of words used, the choice of subject, the 
subdivision into paragraphs, the prevalence of Clauses, headings 
and suo-headings, line length, inter-line distance, illustrations, the 
size of letters, the relevance of the text to the reader and the page 
size. 

The index of readability (LDC) is calculated as follows: 

- Count the number of words in the text. 

- Count the number of words with more than six letters. 

- Count the number of sentences. 

- Divide the number of long words by the number of words and 
multiply the product by 100. Tills yields the average word 
length (WL). 

- Divide the number oi words by the number of sentences. This 
yields the average sentence length (SL). 

- WL + SL = LK. 

20 - 30 = simple text, suitable for children's books 

30 - 35 = Swedish literature 

35 - 45 = moderately diffnult text, weekly magazines 

45 - 50 = popular science subjects 

50 - 55 = difficult text, trade literature 

55 - = extremely difficult text 

The concept legibility refers to a text's extemal properties. These 
are properties such as letter size, interline distance, line length, the 
distance betweei letters, the number of letter per line, the distance 
between words, the typographic style, the subdivision into 
paragraphs, headings, headings in the margin, the layout, color of 
the printing ink and paper, the paper quality etc. These different 
extemal properties have not been found to have a drastic effect on 
legibility as long as the text is presented with the framework of 
variation normally found in contemporary books. It is, however, 
possible to give some general guide-lines to achieve optimum 
legibility: 

- Running text should be in lower case letters. All-capital 
printing has been shown to markedly reduce the speed of 
reading. 

- Typographic styles with serifs, Roman type, are considered to 
be easier to read than line type, sans serif, except for small 
lelter sizes. 
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- Bold face or italics should not be used for continuous text 
They may, however, be used for emphasis of small parts. 

- The optimum line length seems to about 40 characters and 
spaces. This is nine to ten centimetres with optimum character 
size, ten or eleven point, at a normal reading distance. 

- The maximum line length should be about 55 characters and 
spaces. 

- Letter size must be adjusted to the visual format and the 
reading distance. It should be "large enough". Too small or 
too large lettering impair reading. 

- Text with a generous amount of space within it is rated as 
"easier" and more interesting than text which has a more sc.d 
appearance. 

- A larger type size in a single column is preferable to a smaller 
type size in a double column layout 

- Less skilled readers find unjustified text easier to read than 
justified text. It makes no difference for advanced readers. 

- For text printed in black all paper surfaces are equally legible if 
they have a reflectance of at least 70 %. The most legible 
combination is a black text on a light yellow background. 

- In a normal reading situation black print on white paper is over 
10 % more efficient than white on black. When negative text is 
used a larger type with open counters and adequate character 
spacing should be used. 

- Legibility is severely impaired when text is printed over a 
picture. 

- Margins have three main functions. They provide space for 
headings, comments and illustrations. They provide space for 
fingers to hold the book. They make it possible to do notes. 

- The technical quality must be high (see also Technical quality). 

The text should be well worth reading. This designates the 
properties of the content of a text and is very dependent on the 
reader's degree of interest. Each group of readers selects reading 
material on the basis of personal preference. Studies of readability 
have resulted in lists with reading suggestions for various age 
groups. 



Legends 

In existing printed materials we may find legends with several 
different functions. A legend may be just at label. It may convey 
factual content, or information about events. It may also evoke 
emotions. In text books legends may be instructing and directing 
the reader on what to study in the picture. Legends may have 
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redundant, relevant, irrelevant or contradictory relationships to the 
main text and/or to the picture. 

People who look at a visual will to a great extent perceive it 
differently. A visual mean different things to us and evoke many 
different associations depending on our different situations. A 
vivid example of this can usually easily be demonstrated by 
showing people a visual and ask them to write legends or just tell 
you about the content. 

Within the work of a computer based access system to image 
content the Dutch encyclopedia publishing company. Spectrum, 
experimented with models for image classification. An image 
classification system makes sense only if different classifiers 
apply the same objective criteria to the image and subsequently 
different picture researchers are able to locate the same 
illustration. In a first experiment in 1979 twelve editors had to 
classify 25 pictures by using catch words. Results showed a 
correlation as low as 0,2. In a following experiment a questionare 
regarding categories combined with requests for description was 
used. In this case the correlation was 0,67. In the final system, 
1983, all indexing is made in the computer with a calculated 
correlation of 0,80, which seems to be very good. 

These examples show the extreme importance of legends in 
instructional message design. We must tell the reader or viewer 
what we want her/him to see and leam from the illustration. Thus 
every visual should always be supplied with a legend which 
should be brief and easy to understand. In instructional message 
design the function of the legend is to help the reader select the 
intended content in the picture. 

We can use five different strategies for reading legends and 
visuals. A few people read only the texts and ignore the visuals. 
They then use mainly the left half of their brains. Similarly, some 
people mainly use the right half of their brains, and only pay 
attention to the visual. As seen in the suggested model, most 
people use both halves of their brains and utilize both the legend 
and the visual in a legend-visual, a visual-legend or in an 
interactive strategy. It is easy to understand that these different 
strategies result in different learning efficiencies. 

Content of legend 

The legend and the visual should interact as parts of a whole. A 
legend should describe image contents and govern the way a 
picture is read: A picture producer*s intentions about what the 
reader is supposed to see and leam from each illustration should 
be as clear as possible. 

The legend should be redundant in relation to the visual, i.e. 
the legend should supply the same information as the visual. The 
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relationship between legend and visual might also be relevant but 
should never be irrelevant or contradictory. 

Form of legend 

Generally speaking, a legend should be brief and easy to 
understand. It should be edited to fit different reader categories, 

such as general readers (children, teenagers, adults ), technical 

readers and specialist readers. 

A general reader knows little, if anything, about the subject 
matter. The legends and the pictures are kept simple, attractive 
and informative. They should not be too complicated and, thus, 
distracting to the reader. 

A technical reader will understand technical concepts but may 
not be familiar with special terminology. Legends may provide 
detailed explanations of attractive and informative pictures. 

A specialist reader has a good understanding of the subject 
matter Both the text and illustrations, which may consist of 
detailed drawings, graphs, technical photographs, ultrasonograms 
or other realistic pictures or symbols, may be detailed. 

Placement of legend 

The legend should be located below the visual, not alongside it, 
over it or in it 

The legend should have a different typographic size or even a 
different font so it can be easily distinguished from the main text, 
e.g. on a page in a book. The legends should not be in negative 
form in a color picture since the slightest misalignment in printing 
would make the legends extre.nely difficult to read. The legend 
may well have a hiding which summarizes picture contents. 



Image framing 

A frame around an image, or sometimes around an illustration and 
text, may have different functions. Image framing can be 
functional and/or attentional. A frame will separate the image from 
he surrounding context, and draw special attention to information 
within the frame. E.g. in a newspaper, framing is a way of 
helping the readers to combine the corresponding text and pictures 
on the page. 

Registrations of eye fixations on an image, in one version with a 
frame and in another version without a frame, have shown that a 
frame is not distracting for adult viewers. 
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Seventeen subjects viewed a drawing of two flying House Martins. The 
recorded fixations have been plotted on these outlines of the image versions. 
Eight subjects viewed the frame version and made 98 fixations. Nine subjects 
viewed the version without a frame and made 1 17 fixations. 



Interplay of visuals 

In many situations it is a good idea to use pairs of visuals in 
which one is true-to-life, such as a photograph, and the other 
represents an analytical representation, such as a simple line 
drawing . The analytical visual makes it easier for us to 
understand the content, and the realistic visual enables us to 
believe in the content. So the two visuals should be closely linked 
in a carefully thought-out relationship. 
Time scales and charts provide a reference in time and space. 
Sometimes it is necessary to divide a message content into a series 
of visuals. The amount of details can be great or the content can 
include a certain period of time. 



Layout 

A layout is the result of graphic design. The purpose of this work 
is to find a suitable presentation for the content with respect to the 
receiver, the subject matter and the financial situation. 
A page or a spread with only text or with one "painting" might be 
considered to be very beautiful by graphic designers and some 
readers of fiction in books, magazines and journals. In 
"newspaper layout" many different messages has to be com- 
municated. The problem is to communicate a series of 
disconnected messages of infinitely varying significance within a 



268 



287 



ERLC 



limited space, time and economy with a recognizable consistent 
style for each section of the paper. 

In ^'magazine layout" visuals are often very large. The visuals 
have no or a very limited contact with the text. "Fiction layout" 
certainly does not work very well in instructional message design. 
Even in traditional non-fiction publishing, it is often very hard to 
access the infoimation. Picture placement have very often been 
based on aesthetic rather than instructional characteristics. 
Legends and visuals are often piled up in different areas and 
sometimes even on different pages. Here, an effort should really 
be made to achieve the best possible interplay of words and 
visuals. Visuals interact with the legends, with other visuals, 
headings, ranring text, tables, ma^. ^ etc. on a page and on a 
spread in a book, magazine or newspaper. The layout of the 
whole spread should be attractive. However, the mere use of a lot 
of pictures is not enough. In an "artistic layout", the message may 
be effectively hidden. The message is more effectively conveyed 
by an "informative layout", a "lexi vision". A lexivision is a verbal 
and visual presentation of a limited subject on an easily 
surveyable area. Words and visuals interact closely to form a vi- 
sual unity in which the words enhance the impact of the 
instructional content in the visuals, and the visuals clarify the 
abstract mformation in the words and texts. 

Harmony in typography will be achieved when there is good 
relationship between the individual elements in the design and the 
"wholeness". A balanced typography gives an impression of 
quality and credibility. Contrast in typography may be achieved 
e.g. by using different fonts, styles, sizes and colors. 

The basics for instructional message design could be 
summarized in the following: Select Arrangement, Balance and 
Color to maximize Dynamism, Emphasis, Fidelity and Graphic 
Harmony. 
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In this example of a non-fiction layout, the individual visuals compete intensely. 
They are not explained by legends and can be regarded as a ^'non-example" of 
instructional message design. 

(From Borrman et al.. Nu laser vi E. Uppsala 1977. Reduced in size.) 




An example of an "informative layout". Here the documentary and analytic 
drawings and descriptive texts interact in a lexivisual presentation. We read and 
view at the same time. We are provided with clear and concrete information. 
(From Media M^nniskan. Stockholm 1981. Reduced.) 
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A picture is a multidimensional representation of an inner or 
external reality depicting the physical structure of the objects or 
events they represent. A picture can also be described as a more 
or less complicated sense of vision, i.e. awareness of the 
stimulation of the eye*s vision perception cells, with a specific 
content. An inner image, a visual experience, can originate in 
thoughts and in dreams. It may be caused by words, i.e. a picture 
description, without any help of pictures. Every possible visual, 
every format has got different possibilities to supply a specific 
content. This is due to choice of material and type of production. 
At Tsukuba Expo -85 in Japan it v/as possible to view an image 
on an about four square centimetre writch watch television and at 
the same time see the same image on the Sony Jumbotron with a 
screen one thousand square meters large, that is 2.3 million times 
larger. It is easy to understand that these pictures will give the 
viewer different perceptions even though the;, have got the same 
content. 

An artist or a painter producing a picture may use lead, crayons, 
Indian ink, various kinds of paint, paper, canvas and several 
other kinds of materials in different combinations. The actual 
picture is built up of materials and pigment which, according to 
intentions, can be completely separated or gradually mjxed. Apart 
from printing off-line drawings pictures have to be divided in 
small elements in the technical procesr of duplicating. In printing 
the picture is divided by using a screen. The printed dots vary in 
size. Thus it is possible to reproduce photos, drawings and other 
originals with scales of grey and color. Film pictures, on paper or 
film, consist of small grain or pigments which are developed in 
chemico-technical processes. A TV-image is built up by lines or 
picture elements. Todays s> stems use about a quarter of a million 
picture elements. However, better systems have already been 
developed. A detailed picture need to be divided in at least four 
million picture elements to be satisfactory presented. Since each 
single picture element has the ability to change according to the 
greyscale and color content no less than one hundred million bits 
of information is needed. Thus a large computer capacity is 
needed, especially when film- and TV-images are concerned. 
Film uses 24 and TV 25 frames per second. However, computer 
software is available that only takes account of the parts in the 
pictures where changes occur. Thus, the necessary number of 
calculations is limited. 

A common denominator for most types of duplicated pictures is 
their structure with picture elements. Normally, these dots or 
picture elements are very small. At normal reading distance they 
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can hardly be seen. Use a magnifying glass and look at the dots in 
newspaper print! 

An important difference between main categories of pictures is whe 
use of light. All pictures printed in books, magazines, papers and 
other printed matter are seen in the normal directed lighting. In 
TV- and computer screens the light comes through the image. 
Films, slides and overhead transparencies are usually projected on 
a screen. The difference in nature of these groups of pictures is 
important to study. 

It might be possible to organize or classify pictures according to 
their format. The following is such a suggested scheme. 

1. Two-dimensional pictures 

1.1 Passive, finished, pictures 

1.1.1 Still pictures 

handicrafted pictures: drawings, paintings, 
mosaics, textiles etc. on different materials such 
as paper, canvas, glass, stone etc. 
technically crafted pictures: such as 1, lasting 
images with examples such as photo prints, 
printed pictures and 2, projected images such 
as slides, overhead transparencies, microfiche, 
video still images (Mavica) and simple computer 
images 

1.1.2 Moving pictures 

film: in several different formats (8, S8, 16, 35 
mm, widescreen) and types of programmes 
TV: several means of distribution (air, video- 
cassettes, video-discs) and types of programmes 

1.2 Active, dynamic, pictures 

1.2.1 Still pictures 

overhead transparencies with overlays, different 
computer pictures (larger than the screen) 

1.2.2 Moving pictures 

animatedYilm and TV, PiP (S-8) and Bezeler 
(16), animated computer images, video 
teleconferencing, interactive television, overhead 
transparencies with movement 

2. Three-dimensional pictures 

2.1 Passive, finished, pictures 
2.1.1 Still pictures 
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objects such as sculptures and different articles, 
holograms, stereo-images such as viewmaster, 
autosiereo, chromatic stereo, polarized light 

2.L2 Moving pictures 

moving holograms, stereo film such as 
chromatic stereo film, polarized light film, stereo 
TV 

2.2 Active, dynamic, pictures 

2.2.1 Still pictures 

stereo-overhead transparencies with overlays 

2.2.2 Moving pictures 

inner images, live images such as body 
language, sign languages, theatre, dance and 
models 

In all groups images can bt displayed in color as well as in black 
and white. 
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Visuals 

for information 

- Communication 

- Perception, learning and memory 

- Literacy 

- Designing visuals for information 

Current problem areas in verbo-visual research can be 
summarized under the heading Infology, i.e. knowledge of 
information. Infology comprises theoretical and empirical study 
of the way text, images and graphical shapes for informational 
material should be designed so as to optimize communications 
between senders and receivers. Thus, the field covers aspects of 
many "established" disciplines, such as visual arts, information 
science, esthetics, cinema, physiology, graphical design, 
informatics, journalism, communications, art, linguistics, mass- 
communications, pedagogics, semiology, sociology etc. This 
report mainly deal with the "visual'* part of verbo-visual research. 
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